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ABSTRACT 


Packet- switched  networks  are  used  primarily  to  handle  data 
traffic,  but  considerable  interest  has  recently  been  generated  in 
extending  packet-switching  methods  to  also  handle  digitized  voice 
traffic.  New  network  control  procedures  are  needed  to  deal  with 
packetlzed  voice  traffic,  as  its  characteristics  are  different  from 
regular  data  traffic. 

We  present  two  flow  control  algorithms  which  can  be  executed 
in  a  distributed  manner  to  adjust  source  rates  according  ling 

network  conditions.  Although  the  algorithms  were  developed  for 
packet-voice  networks,  they  are  quite  general  and  are  applicable  to 
many  other  systems. 

One  algorithm  is  based  on  an  optimization  theoretic  formulation 
of  the  flow  control  problem.  The  other  has  as  its  major  premise  a 
specific  notion  of  fairness.  Convergence  is  shown  for  both 
algorithms  under  static  condition:;, 

A  program  Is  developed  which  simulates  the  behavior  of  a 
general  packet-switched  network  on  an  individual  packet  basis.  It 
Is  used  to  examine  the  performance  of  the  second  flow  control 
algorithm  under  realistic  conditions. 
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CHAPTER  I 
INTRODUCTION 

The  development  of  packet-switching  concepts  has  been  quite  rapid 
over  the  past  several  years.  Numerous  packet-switched  data  networks 
have  been  designed  and  Implemented  with  much  success.  As  a  result, 
packet-switching  has  Indeed  proved  to  be  a  most  cost-effective  technique 
for  handling  variable  and  bursty  traffic. 

Conversational  (real-time)  speech  is  also  bursty  and  thus  methods 
for  extending  packet-switching  concepts  for  voice  have  been  receiving 
increasing  attention.  The  performance  criterion  of  voice  networks  are 
quite  different  than  that  of  data  networks  and  because  of  this  fact 
network  algorithms  which  have  been  developed  for  packet  data  traffic 
would  yield  unsatisfactory  performance  in  the  case  of  packet-voice 
traffic. 

In  this  thesis  we  present  two  flow  control  algorithms  for  packet- 
switched  networks  which  support  traffic  sources  such  as  voice.  However 
the  algorithms  are  very  general  and  not  exclusively  designed  for  voice 
traffic  and  thus  can  be  applied  to  many  other  systems.  A  convergence 
proof  Is  given  for  both  algorithms  and  performance  of  one  of  the  algorithms 
Is  evaluated  through  computer  simulation. 
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1.1  Circuit-Switched  vs  Packet-Switched 

Traditionally  the  design  of  conmuni cation  networks  for  continuous 
traffic  sources  (e.g.  voice,  data  file  transfers)  has  been  based  upon 
the  concept  of  circuit-switching.  In  circuit- switched  networks  when  a 
conversation  between  two  terminals  is  initiated,  an  end-to-end  circuit 
is  established  for  the  pair  of  users.  The  end-to-end  transmission 
facilities  are  then  dedicated  to  the  users  until  either  party  hangs  up, 
whereupon  the  circuit  is  disconnected.  The  most  familiar  example  of  such 
a  network  is  the  common  carrier  telephone  network. 

Interactive  computer- to-computer  data  transactions  tend  to  be 
bursty  in  nature  and  thus  dedication  of  network  resources  to  each  user 
would  result  in  a  high  level  of  inefficiency.  This  observation  has  given 
rise  to  the  development  of  packet-switching  methods  for  data  transactions. 

A  packet-switched  network  may  be  thought  of  as  a  distributed  pool  of 
resources  (channels,  buffers,  and  switching  processors)  whose  capacity 
must  be  shared  dynamically  by  a  community  of  competing  users  wishing  to 
communicate  with  each  other.  Thus  in  packet- switched  networks  each  user 
dynamically  shares  network  resources  by  using  them  only  when  information 
is  being  sent. 

In  a  normal  voice  conversation  a  speaker  is  active  about  50%  of 
the  time,  and  thus  voice  conversations  using  traditional  circuit-switched 
networks  are  wasting  about  50%  of  the  network  resources.  This  fact  was 
noted  by  telephone  system  engineers  and  during  the  past  two  decades  several 
techniques  have  been  developed  to  take  advantage  of  the  so-called 
"talkspurt/silence"phenomenon  associated  with  conversational  speech. 


V  • 


The  earliest  strategy  was  the  Bell  System  Time  Assignment  Speech  Inter¬ 
polation  (TASI)  [13  used  on  Intercontinental  voice  connections  In  which 
channel  capacity  Is  allocated  only  when  appropriate  hardware  detected 
that  a  subscriber  was  actively  speaking.  Once  the  channel  Is  seized, 
the  speaker  Is  given  uninterrupted  access  to  the  channel.  During 
periods  of  stlence,  the  channel  Is  relinquished  and  becomes  available  to 
other  speakers.  Digital  variations  of  the  original  TASI  concept,  such 
as  Digital  Speech  Interpolation  (OSI)  [2],  and  Speech  Predictive  Encoding 
[3]  have  also  been  Implemented. 

Recently  considerable  interest  has  been  generated  [4],  [5],  In  the 
use  of  packet-switching  methods  for  simultaneously  handling  voice  and 
data  traffic  In  integrated  digital  conmunicatlon  networks.  There  are 
many  features  of  an  all -packet  integrated  system.  Some  of  the  features 
are: 

(1)  switch  economies  can  result  since  facilities  for  storing, 
forwarding,  and  routing  packets  can  be  basically  identical 
for  both  traffic  categories 

(2)  the  capability  to  accommodate  new  applications  which 
must  access  different  types  of  data  or  voice  processes 

(3)  since  conversational  (real-time)  speech  is  bursty  in 
nature  the  packet-switching  concept  allows  one  to 
exploit  this  fact  by  forming  and  transmitting  packets 
only  during  periods  of  actual  speaker  activity. 


The  latter  feature  is  actually  the  major  Impetus  for  the  development 
of  packet-switched  voice  networks  since  it  affords  a  convenient  and 
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powerful  mechanism  for  extending  the  TASI  technique  discussed  previously 
to  multi link  network  configurations. 

1.2  Flow  Control 

Packet-switching  offers  many  advantages,  the  primary  ones  being 
greater  speed  and  flexibility  in  setting  up  user  connections  across  the 
network  and  more  efficient  use  of  network  resources  after  the  connection 
is  established.  Unfortunately  these  advantages  do  not  come  without  a 
certain  danger.  Unless  careful  control  is  exercised  on  the  user  demands, 
the  users  may  seriously  abuse  the  network.  In  fact,  if  the  demands  are 
allowed  to  exceed  the  system  capacity,  highly  unpleasant  congestion 
effects  occur  which  rapidly  neutralize  the  efficiency  advantages  of  a 
packet  network  by  increasing  delay.  Thus  networks  cannot  afford  to 
accept  all  the  traffic  that  is  offered  to  them  without  control.  There 
must  be  rules  which  govern  the  acceptance  of  traffic  flow  from  outside 
the  network  and  coordinate  flow  Inside  the  network.  These  rules  are 
commonly  known  as  "flow  control  procedures".  More  precisely  flow  control 
is  the  set  of  mechanisms  whereby  a  flow  of  traffic  can  be  maintained 
within  limits  compatible  with  the  amount  of  available  network  resources. 

Flow  control  techniques  have  evolved  almost  independently  In 
circuit-switched  voice  systems  and  packet-switched  data  networks  due 
primarily  to  the  differences  In  source  characteristics  and  service 
requirements  for  the  two  traffic  classes. 

In  recent  years  flow  control  strategies  for  data-only  packet  net¬ 
works  have  been  developed  to  a  significant  level  of  sophistication  (the 
reader  Is  referred  to  Gerla  and  Kleinrock  [6]  for  a  very  comprehensive 
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and  up-to-date  overview  of  packet-data  flow  control  methodologies).  The 
basic  approach  Is  to  somehow  curtail  the  rate  of  traffic  generation  under 
heavy  network  traffic  conditions.  This  prevents  excessive  queueing 
delays  from  developing  at  internal  switching  facilities. 

There  has  been  little  systematic  work  done  in  the  area  of  voice 
flow  control.  Currently  the  most  comnonly  used  technique  for  voice  flow 
control  in  circuit- switched  networks  is  simply  call  blocking,  i.e. 
preventing  the  initiation  of  new  calls  during  busy  periods.  The  TASI  type 
systems  are  a  simple  form  of  voice  flow  control  because  they  "freeze-out" 
speakers  when  the  number  of  active  speakers  temporarily  exceeds  the 
available  channel  capacity.  This  "cutout"  phenomenon  results  in  clippings 
and  segmentation  of  certain  conversations  with  an  associated  loss  in 
intelligibility.  Refinement  of  the  TASI  concept  based  on  digital  en¬ 
coding  techniques  have  been  developed  and  implemented  whereby  the 
bandwidth  per  active  speaker  is  systematically  reduced  to  accommodate 
additional  speakers. 

In  developing  flow  control  stategies  for  packet-voice  networks  one 
should  not  simply  apply  the  techniques  developed  for  packet-data  net¬ 
works  because  the  main  performance  objectives  for  the  two  traffic  classes 
are  opposite.  The  criterion  for  data  is  integrity  (i.e.  no  errors)  with 
delay  being  a  secondary  consideration.  Wherease  voice  communications 
like  many  other  real-time  applications,  is  better  off  with  low  delay 
even  at  the  expense  of  reduced  quality. 

Thus  a  reasonable  flow  control  objective  for  voice  is  one  in  which 
delay  remains  small  while  speech  quality  is  dynamically  traded  in  response 
to  network  traffic  variations.  In  circuit-switched  voice  networks  simple 


voice  flow  control  can  be  applied  at  dial-up  time  by  defining  a  bit  rate 
at  which  the  converatlon  will  be  carried  out.  In  Its  extreme  case  this 
reduces  to  call  blocking,  l.e.,  to  an  assigned  bit  rate  of  zero;  In 
the  more  general  case  It  could  imply  that  two  speakers  engaged  In  point- 
to-point  conversation  are  each  assigned  different  bit  rates  due  to  sepa¬ 
rate  routing  of  their  streams  or  because  network  congestion  Is  not 
directionally  symmetrical  between  given  nodes  [7]. 

A  more  dynamic  approach  to  voice  flow  control  can  be  evolved  by 
allowing  bit  rates  to  change  during  actual  conversation.  Very  little 
work  has  been  done  in  this  area  for  circuit-switched  voice  systems, 
partly  because  the  scheme  is  poorly  matched  to  the  notion  of  a  fixed 
capacity  assignment  for  a  given  voice  stream.  One  can  do  better  using 
packet-switched  networks  since  the  speech  quality  of  each  source  can  be 
easily  varied  by  utilizing  speech  encoding  techniques  and  by  discarding 
a  small  percentage  of  its  voice  packets.  Furthermore  instanteneous 
voice  link  overloads  can  be  alleviated  by  appropriate  queueing  and 
buffering  actions. 

1.3  Previous  Work 

At  present  there  has  been  only  one  effort  known  to  this  author,  to 
develop  a  dynamic  packet  voice  flow  control  scheme.  This  effort  was 
initiated  by  M.I.T.  -  Lincoln  Laboratory  (LL).  The  Lincoln  Laboratory 
flow  control  scheme  is  based  upon  a  speech  digitization  concept  called 
"embedded  coding"  first  proposed  by  the  Naval  Research  Laboratory  [8], 
[9].  In  brief  one  encodes  speech  into  a  set  of  priority-ranked  packets 
such  that  if  all  are  received,  the  result  is  high  quality,  high  bit  rate 


-14- 


voice  output.  If  lower  priority  packets  are  not  delivered,  the  synthesizer 
can  still  use  the  received  high  priority  subset  to  produce  speech  at  a 
lower  but  still  useable  bit  rate. 

Although  embedded  packetization  by  itself  does  not  constitute  a 
flow  control  strategy,  it  affords  a  mechanism  by  which  voice  rates  can 
be  adjusted  downward  by  network  switches  on  a  packet-by-packet  basis 
without  waiting  for  control  messages,  etc.,  to  propagate  through  the 
network  to  various  voice  terminals.  In  effect,  it  permits  intermediate 
nodes  to  instantly  reduce  the  bit  rates  of  voice  conversations  as  needed, 
by  discarding  lower  priority  packets,  without  total  loss  of  communication. 
This  capability  allows  one  to  initiate  global  flow  control  strategies 
for  dealing  with  source  coder  rates.  However,  one  should  note  that  if 
there  are  bottleneck  links  in  the  network  this  scheme  would  Ipad  to 
inefficiency  since  a  large  amount  of  network  resources  would  have  been 
spent  on  traffic  which  gets  discarded. 

An  end-to-end  voice  bit  rate  control  technique  has  been  suggested 
for  use  In  conjunction  with  an  embedded- coding  packet  network  [10]. 

In  brief  voice  conversations  are  conducted  over  fixed  routes.  Traffic 
overloads  at  intermediate  nodes  are  handled  by  discarding  voice  packets 
of  lower  priority  which  tends  to  lower  the  bit  rates  at  which  users 
communicate.  Each  voice  terminal  reports  the  bit  rate  at  which  it  is 
receiving  speech  traffic  to  its  companion  terminal  across  the  network. 
Transmitting  encoders  respond  to  this  information  by  appropriately  dis¬ 
carding  packets  before  they  enter  the  network,  thereby  matching  their 
rates  to  prevailing  network  conditions.  Provision  is  made  to  allow 
rates  to  increase  when  network  links  are  lightly  loaded. 
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The  performances  of  the  Lincoln  Laboratory  flow  control  schemes  were 
evaluated  by  a  computer  simulation  program  [11].  The  simulation  used  a 
model  network  which  consists  of  a  central  node  through  which  pass  16  paths 
connecting  four  nodes  on  either  side  of  the  central  node.  The  model 
provides  two  hops  from  source  to  destination  along  with  competition  for 
resources  at  the  central  node. 

The  simulation  was  performed  for  three  separate  cases,  each  case 
incorporating  a  different  type  of  end-to-end  feedback  control  strategy. 

In  general,  feedback  control  systems  have  the  potential  for  unstable 
behavior  (i.e.  oscillations),  and  in  fact  two  of  the  four  L.L.  simulation 
experiments  have  shown  that  extreme  temporal  variations  in  received 
speech  can  result  from  inappropriate  feedback  control  dynamics. 

The  third  L.L.  end-to-end  flow  control  scheme,  the  so-called 
"phantom- probe"  strategy,  resulted  in  constant  steady  state  received 
bit  rates  when  tested  under  the  same  network  conditions.  Although  the 
phantom- probe  strategy  appears  to  achieve  the  desired  goal  of  developing 
a  flow  control  strategy  which  maintains  stable  operation,  it  is  by  no 
means  clear  whether  this  behavior  would  be  achievable  in  more  general 
large  scale  networks. 

1 .4  Motivation 

Our  attention  was  first  drawn  to  the  area  of  voice  flow  control 
after  examining  the  L.L.  flow  control  scheme  and  its  corresponding 
simulation  results.  Our  preliminary  research  work  was  to  develop  and 
analyze  a  simplified,  analytical  model  of  the  L.L.  flow  control  scheme. 
Since  the  objective  of  our  Investigation  was  to  yield  some  general 
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results,  we  decided  to  focus  our  attention  on  the  end-to-end  control 
process  rather  than  the  effects  of  the  "packet-stripping"  operation. 
Hence,  we  neglected  the  capability  of  discarding  packets  at  intermediate 
nodes  in  the  network  (i.e.  local  control)  and  assumed  that  control  was 
carried  out  by  only  allowing  source  rates  to  change  in  accordance  with 
received  feedback  reports.  We  further  assumed  that  all  sources  were 
deterministic  (i.e.  the  rate  of  all  sources  were  dictated  by  the  state 
equations  which  govern  the  evolution  of  the  system)  and  that  all  critical 
delays  were  known  precisely. 

In  brief  our  findings  showed  that  in  order  to  insure  prevention 
of  received  rate  oscillations,  the  end-to-end  feedback  control  scheme 
must  properly  take  into  account  the  presence  of  delay  between  the  time 
control  decisions  are  made  and  the  time  they  take  effect. 

Although  the  original  objective  of  Our  investigation  was  not  to 
develop  a  stable  end-to-end  flow  control  scheme,  the  results  of  our 
investigation  did  however  yield  sufficient  knowledge  to  properly  do 
so.  Basically,  it  was  this  new  insight  and  the  fact  that  no  known 
analytical  work  had  been  done  in  the  area  of  packetized  voice  flow 
control,  which  supplied  us  with  the  necessary  impetus  to  initiate  our 
research  effort. 

1.5  Problem  Description 

Equipped  with  our  Important  preliminary  findings  our  goal  is  to 
systematically  develop  a  stable  and  robust  adaptive  voice  flow  control 
scheme  which  would  be  both  analytically  and  practically  sound. 

The  main  functions  of  the  flow  control  scheme  shall  be: 


0)  prevention  of  excessive  delays  due  to  overloads 
(2)  fair  and  efficient  allocation  of  resources  among 
competing  users. 

Unfortunately  the  efficiency  and  fairness  objectives  do  not  always 
coincide.  One  of  the  functions  of  flow  control,  therefore,  is  to  prevent 
unfairness  by  placing  selective  restrictions  on  the  amount  of  resources 
that  each  user  may  acquire,  in  spite  of  the  negative  effect  these 
restrictions  may  have  on  network  efficiency.  In  addition,  the  fairness 
criteria  is  one  which  is  highly  debatable  and  thus  adequate  evaluation 
of  how  a  particular  fairness  policy  interacts  with  a  specific  flow 
control  scheme  must  be  carried  out  in  order  to  establish  the  strategy 
which  achieves  the  "best"  overall  network  performance. 

In  order  for  any  flow  control  scheme  to  be  readily  adaptable  to 
current  existing  packet- networks,  it  should  not  place  any  severe  re¬ 
quirements  on  the  network  structure.  For  example,  the  L.L.  flow  control 
scheme,  which  requires  specific  packet-stripping  operations  to  be  per¬ 
formed  at  every  network  link  suffers  "loss  of  modularity",  because  it 
demands  that  the  network  be  matched  to  the  peculiarities  of  the  digi¬ 
tizers.  As  a  result,  we  have  decided  at  this  time  to  carry  out  our 
control  by  adaptively  adjusting  the  source  rates  in  accordance  with  the 
prevailing  network  conditions,  only  at  the  gates  of  the  network.  We 
assume  that  voice  quality  will  vary  monotonically  with  source  rate, 
where  in  general,  the  higher  the  source  rate,  the  better  the  voice 
quality. 

Thus,  the  overall  objective  of  the  control  scheme  is  to  allow  a 
graceful,  and  fair  degradation  of  user  service  as  network  traffic 
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increases,  and  a  fair  improvement  of  user  service  as  traffic  decreases. 

1 .6  Thesis  Outline 

The  goal  of  this  thesis  is  to  develop  flow  control  algorithms 
which  achieve  the  desired  objectives  described  in  section  1.5. 

In  chapter  II  we  first  specify  our  network  model  and  formulate 
the  problem  mathematically. 

Using  the  tools  of  optimization  theory,  in  chapter  III  we  view 
flow  control  as  an  optimization  problem.  After  a  general  discussion 
of  distributed  algorithms  we  present  a  decentralized  algorithm  to  solve 
the  optimization  and  a  proof  of  its  convergence. 

A  flow  control  algorithm  based  on  a  notion  of  "fairness" 
coincident  with  the  standard  voice  communication  network  policy  is 
first  motivated  and  then  developed  in  detail  in  chapter  IV.  A  distributed 
version  of  the  algorithm  is  given  and  is  shown  to  always  converge  to 
the  unique  optimal  solution.  Possible  extensions  to  the  original  scheme 
are  also  discussed. 

In  chapter  V  a  detailed  computer  simulation  program  suitable  for 
general  packet- switched  networks  is  first  developed.  This  program  is 
then  used  to  examine  the  performance  of  our  flow  control  algorithms 
presented  in  chapter  IV.  Results  for  several  cases  are  examined. 


I 


CHAPTER  II 


GENERAL  FORMULATION 


In  this  chapter  we  formulate  the  flow  control  problem  for  a 
store  and  forward  packet-switching  network.  However,  our  formulation 
is  quite  general  and  can  be  used  for  the  design  of  flow  control  strategies 
in  other  types  of  communication  networks.  After  the  model  Is  discussed, 
we  present  the  mathematical  formulation  of  the  flow  control  problem. 
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2.1  The  Network  Model 

Consider  a  store  and  forward  packet-switching  network.  The 

network  traffic  is  voice  in  steady  exchange  between  users.  We 
will  refer  to  those  users  who  are  engaged  in  a  conversation  as  active, 
all  others  will  be  referred  to  as  inactive.  In  general  as  time 
proceeds  some  of  the  active  users  may  become  inactive  and  some  of  the 
inactive  users  may  become  active.  Although  we  are  primarily  interested 
in  developing  flow  control  schemes  for  a  quasi-static  situation,  that  is 
a  situation  whereby  the  users'  requirements  change  slowly  in  time,  for 
the  purpose  of  theoretical  development  of  the  problem  we  consider  a 
static  case. 

The  static  case  assumes  that  all  active  users  are  always  active 
and  all  inactive  users  are  always  inactive.  Furthermore  we  assume 
that  each  active  user  always  has  some  information  he  wishes  to  transmit. 
Clearly  the  proceeding  assumptions  allow  us  to  view  the  behavior  of 
all  network  users  as  being  deterministic  in  the  sense  that  there  is  no 
uncertainty  associated  with  the  message  arrival  process.  In  addition 
inactive  users  will  be  of  no  concern  to  us  in  our  development  and  thus 
we  shall  not  consider  them  in  our  model. 

Let  use  assume  that  the  store/forward  packet  switching  network 
consists  of  M  active  users  and  N  communication  links. 

LetVdenote  the  set  of  all  users  in  the  network: 

V  *  {u{|  i  •  1 . M>  . 

Let  L  denote  the  set  of  all  links  in  the  network: 

L  *  (j|  j  *  1 . N)  . 
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Let  r*j  denote  the  rate  in  (bits/sec)  at  which  user  u^  transmits 
Information. 

In  vector  form: 


If  A 


For  the  purpose  of  accomplishing  flow  control  in  the  network  we 
assume  that  it  Is  somehow  possible  for  each  user  to  set  its  rate 
to  the  value  which  Is  determined  by  the  flow  control  algorithm.  The 
actual  practical  method  for  accomplishing  this  will  be  discussed  later. 

Now  let  f j  denote  the  flow  of  traffic  in  (bits/sec)  on  link  j. 

In  vector  form: 


We  assume  that  each  network  user  utilizes  a  single  fixed  route 
to  carry  out  its  conversation.  Due  to  our  previous  static  assumptions 
we  note  that  the  contribution  of  traffic  flow  due  to  a  particular  user, 
say  u^,  is  equal  on  all  links  which  user  u,.  utilizes  in  his  route. 
Furthermore,  the  value  of  this  flow  contribution  is  precisely  equal  to 
the  rate  of  user  u^,  namely  r^. 

To  complete  our  network  model  we  introduce  a  link-user  incidence 
matrix,  denoted  H.  The  purpose  of  the  H  matrix  is  simply  to  describe 
in  a  convenient  form  the  set  of  links  which  each  user  utilizes. 
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Let 

'hll 

hlM' 

H  A  i 

hij 

N 

-hNl 

hNH 

where 

1 

if  user  j 

utilizes  link  i 

J  (  0  otherwise 

At  this  pointour  preceding  assumptions  and  definitions  allow  us 
to  state  the  following  relationship: 

V  £,  hj1  r1  ’Ui"  (2-D 

or  in  vector  form; 

?  -  HR  (2.2) 

In  practice  the  maximum  allowable  traffic  flow  on  a  link  is  limited 
due  to  physical  constraints.  However  for  theoretical  development  we 
will  view  the  goal  of  flow  control  as  determining  optimum  (in  some 
specified  sense)  user  rates,  which  allow  each  link  i  to  be  utilized 
up  to  some  value  smaller  than  the  capacity  which  we  will  call  the 
effective  link  capacity,  denoted  c^.  If  we  admit  that  the  algorithm 
will  effectively  maintain  the  flow  close  to  the  desired  maximum  (say 
0.8  of  the  true  capacity)  we  can  assume  that  the  true  capacity  is 
infinite. 

★  ★ 

Thus  if  r.  and  f .  denote  the  optimum  user  rate  assignments 

*  J 

and  resultant  link  flows  respectively,  we  must  have: 


1  <  j  <  N 


(2.3) 


or  equivalently  using  (2.1), 

H 

£  hji  ri  i  cj  1  i  J  <  N  (2.4) 

i=l 

2.2  Mathematical  Formulation 

In  order  to  mathematically  formulate  the  flow  control  problem  we 
must  first  select  an  appropriate  network  objective  function.  A  reasonable 
objective  function  is  one  which  takes  into  account  the  satisfaction  of 
the  network  users.  Clearly  the  higher  the  rate  at  which  a  user  is 
allowed  transmit  the  more  satisfied  he  is  with  the  quality  of  service 
which  he  is  receiving.  With  this  objective  in  mind,  for  each  user  u.. 
we  create  a  reward  function  denoted  e(r^),  which  is  an  increasing  function 
of  the  rate  r..  allocated  to  user  u^.  A  typical  function  is  shown  in 
Fig.  2.1. 


Figure  2.1  Typical  User  Reward  Function 


V 
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Note  that  the  convex  n  shape  of  the  curve  in  Fig.  2.1  Is  a  reasonable 
model  of  user  satisfaction  since  one  would  expect  that  there  is  less  to 
be  gained  by  allocating  additional  rate  to  a  user  which  already  benefits 
from  a  high  rate.  In  addition  r!^*  is  the  maximum  rate  at  which  user  u^ 
would  ever  wish  transmit. 

Formally  we  have  the  following  definition. 

Definition  2.1  For  each  user  of  the  network  u..,  there  is  a  reward 
function  e^(r^)  assigned  with  the  following  properties: 

(1)  increasing  on  [0,r|?ax  J 

(11)  ei  (r^ )  is  convex  n  on  [0,rl?ax  ] 


We  now  form  an  aggregate  network  reward  function  as; 

E(R“)  s  T { e j ( r j ) }  (2.5) 

where  T(x)  Is  some  specified  function,  which  operates  on  the  set  (x)  . 

In  the  chapters  which  follow  we  will  consider  the  development 
of  flow  control  algorithms  to  maximize  two  different  network  objective 
functions  subject  to  the  constraint  (2.4). 
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CHAPTER  III 

OPTIMIZATION  THEORY  APPROACH 

Our  primary  goal  in  this  chapter  is  to  show  that  the  flow 
control  problem  can  be  formulated  and  solved  as  a  convex  optimization 
problem.  It  is  similar  to  the  work  of  Golestaani  [15],  except  that 
the  routing  problem  is  ignored,  and  the  constraints  are  different. 

In  the  first  two  sections  we  formulate  the  problem  and  determine 
the  optimality  conditions.  Next  we  discuss  distributed  network 
algorithms  within  a  general  context  and  then  develop  the  distributed 
flow  control  algorithm. 

Finally,  we  show  that  convergence  is  guaranteed  under  certain 
conditions  and  discuss  the  implications  of  those  conditions. 


I 


3.1  Problem  Statement 

In  this  chapter  we  choose  as  our  network  flow  control  objective 
function  simply  the  sum  of  the  Individual  user  reward  functions.  The 
rationale  for  choosing  this  cost  function  is  to  see  whether  fts  simplicity 
leads  to  an  efficient  and  easily  implementable  optimization  algorithm. 

Thus  we  let  T{x}  =  in  (2.5)  and  hence 


E  aft  •  £  ej(rj) 
j=l 


(3.1) 


Note  that  E(R)  is  convex  n  in  ]t.  Now  using  (2.3)  we  can  formulate  the 


convex  optimization  problem  as 

Max  E(R) 

{ri} 


(3.2a) 


fi  -  Ci 

Max 

0  <  r .  <  r . 

“  J  “  J 


1  <  i  <  N 


1  <  j  <  M 


(3.2b) 


(3.2c) 


Since  our  optimization  variables  are  the  { r^>  we  restate  constraint 
(3.2b)  in  terms  of  the  (r.)  by  using  (2.4)  and  as  a  result  we  have  the 
following  equivalent  formulation: 

Max  E  (R)  (3.3a) 


E  hij  *j  i  ci 
j=l 


1  <  i  <  N 


(3.3b) 


0  <  rj  i  r  j 


1  <  j  <  M 


(3.3c) 
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3.2  Optimality  Conditions 

Theorem  3,1  The  necessary  and  sufficient  conditions  on  { r*} 
for  the  solution  of  (3.3)  is  that  a  set  of  non-negative  numbers  {x^J 
1  <_  i  N  exist  such  that 

for  1  1  j  ±  M 


Proof  of  Theorem  3.1 

E(R)  is  a  concave  function  defined  over  a  convex  set  XCFN 
thus  the  set  X*C  X  where  E(tf)  achieves  a  maximum  is  also  a  convex  set. 
Furthermore  every  local  maximum  of  E(lf)  over  X  is  a  global  maximum. 

Using  the  preceding  observation  and  the  fact  that  (3.3b)  and  (3.3c)  are 
linear  constraints  we  have  the  following  proposition. 


Proposition  3.1 


The  necessary  and  sufficient  conditions  on  a  feasible  if*  to 
maximize  E(lf)  is  that  there  exist  unique  vectors: 


Such  that 


j£  (if  )  ^  *  *  * 

yft  1  +  lh  -  v  +  u  *  0 

2^  Ai  ij  'j  j 
1=1 


3r 


j 


1  <  j  <  M 


(3.5a; 


M 


*  xi  r e  hi j rj •  cii 
L  i=l  J 


1  <  i  <  N 


(3.5b; 


Y*>0 


1  <  j  <  M  (3.5c 


it  it  ★  Max 

uj  >  0  *  uj(rj  -  rj  )  *  0 


1  <  j  <  M 


(3.5d] 


Proof  of  Proposition  3.1 
See  Luenberger  [12]. 

Now  observe  that: 


9E(lf*) 


deJ<rj> 

drJ 


(3.6) 


We  can  reduce  the  preceding  set  of  conditions  by  eliminating  the  presence 
of  both  y  and  U 

This  can  be  done  as  follows: 
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Examlne:  (3.5c),  and  (3,5d),  we  have  three  cases  to  consider: 


0)  0  <  Pj  < 

(11)  r,  *  0 

*  Max 
(ill!  Pj-rj 


( i ) :  Assume  0  <  r*.  <  r?ax 

J  j 

★ 

Then  (3.5c)  implies  y.  -  0  and 

j 

(3.5d)  Implies  ut  =  0. 

J 

Applying  the  preceding  results  to  (3.5a)  and  multiplying 
■1,  we  have  ; 


de.(rt) 


as  desired. 


M 

£hu 

1=1 


0  <  r  <  rMax 

J  J 


1  <  j  <  M 


Case  (11): 


Assume  r.  =  0 

J 

•ft 

Then  (3.5c)  implies  y.  >_  0 

s) 

•ft 

and  (3.5d)  implies  u.  =  0 

J 

Applying  this  result  to  (3.5a)  we  have: 


de  j(r,)  M  *  *  # 

-k1-  -  £  M  Nj  ■  -Yj  i 0  for  ■ 0 

J  1-1 

1  <  j  <  M 


as  desired. 
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*  Max 

Case  (111)  Assume 

Then  (3.5c)  Implies  Tj  *  0 

* 

and  (3,5d)  Implies  u^  >.  0 
Applying  this  result  to  (3.5a)  we  have: 


vr!1 


i«l 


*  Max 
for  r*  .  rj 

1  <  j  <  M 


'tf 

Combining  the  three  cases  and  noting  that  >  0,  1  <.  i  5.  N,  we  get 
the  desired  result.  Q.E.D. 


Having  completed  the  formulation  of  the  optimization  problem 
and  the  statement  of  optimality  conditions  we  are  now  ready  to  proceed 
with  the  development  of  the  distributed  algorithm. 
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3.3  Distributed  Algorithms:  A  General  Discussion, 

A  distributed  algorithm  is  one  in  which  the  links  cooperate  in 
an  organized  fashion  to  perform  the  desired  network  optimization.  Thus 
we  associate  with  each  link  a  control  value  which  is  computed  on  the 
basis  of  local  information  and  resources.  Let  us  denote  the  control 
value  for  link  i  as  S.. 

For  each  user  there  is  a  relationship  which  allows  us  to  determine 
the  user's  rate  as  a  function  of  the  link  control  values  associated  with 
the  user's  route. 

Basically  to  solve  the  network  optimization  problem  the  link 
control  values  are  varied  in  an  appropriate  manner  until  the  optimum 
user  rates  have  been  assigned  and  from  this  point  on  in  time  the  control 
values  should  remain  constant.  Each  time  the  link  control  values  are 
updated  the  appropriate  Information  regarding  each  user's  route  must 
be  communicated  to  the  users.  Two  practical  methods  for  accomplishing 
this  are  as  follows. 

Method  (1 ) ;  There  is  a  special  data  field  in  the  user's  packet 
denoted  control  Information.  Each  time  the  packet  passes  through  a  link 
along  its  route,  the  link  processor  reads  the  information  In  the  control 
field  and  then  using  its  current  control  value  performs  the  data  manipu¬ 
lation.  The  resultant  is  then  written  into  the  control  field.  When 
the  packet  finally  arrives  at  Its  destination  the  information  residing 
in  the  control  field  Is  somehow  comnunicated  back  to  the  source. 

Method  (2):  Periodically  each  node  in  the  network  broadcasts  to 
all  its  neighbors  the  identity  and  current  control  value  of  each  of  its 
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outgoing  links.  When  a  node  receives  such  a  list,  it  rehroadcasts  this 
list  to  all  its  neighbors.  Eventually  by  flooding  every  source  in  the 
network  will  learn  the  link  control  value  for  eyery  link  in  the  network. 
Then  each  source  can  simply  compute  its  rate  as  function  of  the  link 
control  values,  assuming  it  knows  the  path  associated  with  its  conversation. 

In  practice  there  must  be  a  finite  period  of  time  between  control 
value  updates  and  hence  changes  in  user  rates.  A  certain  period  of  time 
is  necessary  for  each  link  to  gather  local  information  about  its  status 
and  to  perform  the  control  update  computation.  We  will  call  this 
period  of  time  the  link  observation  period,  denoted  dQ.  In  addition 
because  of  the  presence  of  finite  feedback  delay  a  period  of  time  is 
necessary  to  communicate  the  user's  current  control  information  from  the 
destination  back  to  the  user.  We  will  call  this  period  of  time  the 
feedback  delay,  denoted  dp. 

It  should  be  clear  from  the  preceding  discussion  that  we  are 
dealing  with  a  continuous  time  process  upon  which  we  make  control  value 
updates  and  user  rate  changes  at  discrete  time  increments.  Fig.  3.1 
illustrates  the  basic  interaction  between  the  various  time  periods. 
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It  is  obvious  from  Fig,  3.1  that  the  fundamental  time  duration 
between  either  control  or  rate  updates  Is  simply  the  sum  of  the  observation 
period  (dQ)  and  the  feedback  delay  period  (dp).  Me  shall  denote  this 
period  of  time  by  the  variable  dy,  that  is  dy  *  dQ  +  dp 

With  the  preceding  conclusions  In  mind,  in  parallel  with  our 
earlier  notation  let  us  now  make  the  following  definitions. 


Definition  3.1  Let  r^(k)  denote  the  rate  of  user  u^  in  (bits/sec) 
for  the  time  period  [k,  k+dy].  In  vector  form 


R(k) 


^(k) 


(user  -  rate  vector) 


Definition  3.2  Let  f.(k)  denote  the  flow  of  traffic  on  link  j  in 

J 

(bits/sec)  for  the  time  period  [k,  k+dy).  In  vector  form  we  have: 


tl  k)  = 


f,  M 


Vk> 


(link  -  flow  vector) 


Definition  3.3  Let  $.{i)  denote  the  link  control  value  for  link  j  for 

J 

the  time  period  [1  -  dp,  i+dQJ .  In  vector  form  we  have: 


S(D 


S-j  (i) 


(link  -  control  vector) 


Now  note  that  we  can  use  def.  3.1  and  3.2  in  (2.1)  and  (2.2)  to 


get  (3.6)  and  (3.7)  respectively. 


M 

f i Ck>  *  £  hij  rjW  (3.6) 

j*l 

F(k)  =  Hff(k)  (3.7) 

Below  we  portray  In  an  analytical  format  a  typical  sequence  of  algorithm 
operations 

5*(k)  -  Tf(k)  +  f(k)  -  ?(.k+dT)  -  R(k+d?)  -  F(k+dy)  (3.8) 

or  equivalently 

S(N)  -►  R(N)  -*-V(N)  -►  S(N+1)  -  R(N+1)  +  F*(N+1 )  (3.9) 

To  get  (3.9)  from  (3.8)  we  simply  normalize  our  fundamental  time  basis 
by  d.p  Unless  otherwise  specified  we  will  assume  for  now  on  that  dT 
has  been  normalized  to  1. 

3.4  Development  of  Distributed  Flow  Control  Algorithm 

The  objective  of  this  section  is  to  develop  an  algorithm  which 

solves  for  the  optimum  user  rates  of  (3.3)  In  an  iterative  way  using 

distributed  computation.  In  order  to  gain  some  insight  into  how  this 

may  be  accomplished  it  is  first  useful  to  view  as  the  "cost"  of 

link  1.  Basically  it  can  be  interpreted  as  the  incremental  "cost"  of 

sending  flow  on  link  1.  With  this  idea  in  mind  we  can  view 
M  . 

53  h, .  X*  as  the  cost  of  user  u*  s  route,  since  it  is  simply  the  sum 
1*1  1  J 

of  the  costs  of  all  links  contained  in  u^'s  route, 

J 

It  is  clear  that  we  should  choose  the  link  control  values  (S^) 
to  be  completely  equivalent  with  {x^Jand  the  two  sets  are  distinguished 
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only  for  notatlonal  convenience. 

In  the  preceding  section  we  found  that  in  order  to  develop  a 
distributed  algorithm  two  basic  relationships  must  be  determined.  They 
are: 

(1)  the  relationship  between  the  rate  of  each  user 
and  the  link  control  values  corresponding  to  this 
route 

(ii)  The  link  control  value  update  equation. 


We  use  equation  (3.4a)  to  specify  (i)  as 


de-(r.)  N 

=  £  hij  xi  (3-10> 

J  i=l 

At  this  point  we  make  the  following  definitions: 


Definition  3.5  The  function  g.(r.)  of  user  u.,  T  <_  j  M  is  its 

0  J  J 

marginal  reward  function,  i.e. 


•W  - 


de.i(rj) 

drT 


(3.11) 


The  function  g.(r.)  has  the  interpretation  that  it  is  the  incre- 

w  J 

mental  gain  for  additional  allocation  to  user  Uj. 

Now  using  (3.11)  in  (3.10)we  get 


9 


N  • 

£  hij  Si 


1-1 


1  <  j  i  M  (3.12) 


-3 


Definition  3.7  let  d..  represent  the  total  cost  of  user  u,-  s  route. 

—  J  J 


Thus: 


-  t  h1j  S1 

i=l 


1  <  0  <  M 


(3. 


and 


-r  -  ^ 


(3. 


rj.0 


.Min.  dejlrj) 

'J  ' 


(3. 


^  ■  -r 


Thus  using  def.  3.7  in  (3.12)  we  have: 

»J<rj>  *  <*3  ■  1  ^  H 

In  words,  (3.14)  states  the  reward  for  user  u.  is  equal  to  the 
cost  of  its  route. 

A  typical  g^(r^)  is  shown  in  Figure  3.2. 


(3. 


Fig.  3.2  Typical  User  Marginal  Reward  Function 


r,  , . 
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Deflnltlon  3.8  Let  bj(dj),  dj  6  [0,»]  be  defined  as  follows 

rj  ■  bj(dj)  *  Inverse  of  [gj(rj)]  i  dj8x  (3.15a) 

rj  “  bj(dj)  *  0  dj  >  dj*x  (3.15b) 

rj  “  bj(dj)  '  rT*  0  <  dj  <  djin  (3.15c) 

A  typical  bj(dj)  Is  shown  In  Figure  3.3 


Fig.  3.3  Typical  User  Rate  Assignment  Function 


Now  note  in  vector  form  (3.13)  becomes 
D  *  H1  S 

and  using  (3.15) 

R  =  B(d}  =  B(HT  S) 

where 


(3.17) 

(3.18) 

(3.19) 


Next  we  must  specify  (11).  Equation  (3.4b)  Is  the  kqy  to 

determining  the  link  control  update  equation.  It  Is  repeated  below  for 

* 

the  reader's  convenience*  except  we  have  replaced  Xj  by  the  equivalent 
* 

variable 

Sjtfj  -  c,]  *  0,  1  <  i  <  N  (3-20) 

In  words  (3.20)  simply  states  that  If  at  the  optimum  point  link  1  Is  not 
saturated,  then  the  solution  value  for  link  1 1 s  control  variable,  namely 
S*  will  be  identically  equal  to  zero.  Thus  intuitively  an  update  equation 
for  S.j  would  be  one  which  decreases  its  value  at  each  Iteration  by  a  fixed 
amount  as  long  as  the  link  has  not  become  saturated.  Since  must  be 
non-negative  we  must  require  that  have  a  minimum  value  of  zero.  The 
following  definition  formally  defines  the  update  equation. 


Definition  3.8  Let  each  link  j,  1  <  j  <  N  have  associated  with  it 
the  following  link  control  value  update  equation. 

Sj(new)  *  tS j (old)  +  6 ^ (f j (old)  -  Cj]+ 
where  is  a  positive  constant  and  the  notation  [x]  *  Max(O.x). 


(3.21) 
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In  vector  form  we  have; 

lf(new)  *  [5*(old)  +  e(?(o1d)  -  c)]+  (3.22) 

where 

4 

“  \o 

P  d 

-  ™ 

and  the  notation  [x}+  *  (x^)+ 

.<V+. 

Now  using  (3.7)  in  (3.22)  we  get: 

S(new)  =  [^(old)  +  6  (H  lf(old)  -  C*  ]+  (3.23) 

In  order  to  get  a  mapping  from  ^(old)-*-  ^(new),  we  need  to  express 
tf(old)  in  terms  of  ^(old).  This  can  be  accomplished  through  the  use  of 
(3.18).  Thus  we  finally  arrive  at  the  desired  mapping: 

S^new)  =  [S*(old)  +  e  [H  B  (HT  S^old)  -  ~c  ]]+  (3.25) 

Let  us  denote  this  mapping  by  2  .  Hence  we  have 
S*(old)  «=  Z  [5*(old)]  *  5*(  new) 
where  Z:*N  -  FN  . 


(3.26) 
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3.5  Proof  of  Convergence 

Theorem  3.2  Let  e j ( r j )  be  a  continuous  convex  function  for 

Max  h 

Tj  6  [0,rj ].  The  second  derivative,  i.e.  e^  (r j )  Is  piecewise 

continuous  and  smaller  than  (-1/k.). 

J 

If  the  e  matrix  is  appropriately  chosen,  then  the  algorithm 
described  by  (3.15)  and  (3.23)  produces  a  sequence  ff(N)  converging  to 
a  ft  maximizing  E(^)  subject  to  H  if  <_  C  and  0  R  £  R^ax  . 

Proof  of  Theorem  3.2 

The  function  e-(rj  is  strictly  convex  and  as  a  result  the  objective 
J  J 

function  E(^)  has  a  unique  maximum.  Furthermore,  the  derivative  of 
ej(rj)  is  strictly  decreasing.  Thus  the  function  bj(dj)  defined  In  (3.15) 
is  well  defined,  continuous  and  piecewise  differentiable. 

As  the  e..  are  convex  n  nd  differentiable  and  the  allowable  region 
for  ^  is  convex,  it  is  well  known  (e.g.  See  Luenberger  [12])  that: 


or 


Max  E(R) 

*  Max 

R>0 

tf>0 

fc,(Max 

equally. 

Max  E(R) 

■  Min 

fco 

5>Q 

H?<C 

Min  [E(R)  +  ZJ(?  -  Hi?)  ] 
S>0 


Max[E (J?)  (c-  Hlf)] 

1 t<f*x 


(3.27) 


(3.28) 


We  denote 


(3.29 


Max  [E(tf)  +  ^(t-  Hi?)]  b  *(S) 

to  y 

%if Max 

Then, 

Max  E(R)  «  Min  ♦  (§* )  (3.30 

1&0  5>0 

3  -i  ~ 

HR<C 

— 1  _i  May 

R<R  X 

Note  that  for  a  given  s,  [E(R)  +  s*(C*  -  Hi?)]  Is  maximized  by  an  1?  which 
satisfies: 

(V^E(1?)  -  S*  H)^  f=0,  0  <  rj  <  r^x  (3.31 

\  <  0  ,  r j  «  0  (3.31 

(>0,  r0*  >  rj3x  (3.31 

In  other  words  the  optimal  ^  is  B(H^  51).  This  is  effectively 
implemented  in  (3.15). 

Where  it  exists,  the  gradient  of  <j>(5}  is  given  by: 

?_»  4>(s)  *  [E(l?)  +  5*^  -  Hi?)]  7  tf(x)  HT  +  (C* -  H  J?)T  (3 

SR 

R=B'(HTs)  x=HTs  £B*(HTs) 

Note  in  (3.32)  that  the  jth  component  of  the  first  factor  on  the  right 
hand  side  Is  0  if  0  <  r^  <  rj8x  ,  whereas  the  jth  component  of  the 
second  factor •*  is  0  for  r^  K  0  or  rj  >  rjax.  Thus  the  product  of 
the  first  two  factors  is  identically  0  (the  identity  on  all  boundaries 
is  checked  by  examining  the  left  and  right  derivatives).  Hence: 

7_  ♦  (t)  ■  (c  -  H*)T. 

s 


(3.33 


-43- 


-44- 


Thus  we  desire  for  ^  t  tf , 

rf*)T  erf*)  >  Jrf*)TeHK  HT  erf*) 
Since  e  Is  diagonal,  e  *  (e^2)T  (e^2) 


(3.41) 


.  1/2 


where:  e 


So  (3.41)  becomes 


(3.42) 


(jiV  (e'/2)T  (e1'2)*"  »  i  (f)T  (e'/2)[(E1/2)  HKHT  (,1«)T](,1/2)f 


Let  t  •  (e1^2  A**),  then  (3.43)  becomes 
[I  -  ^(e1/2  HKHT  e1/2)]  X  >  0 


V  t  f  tf 


(3.43) 


(3.44) 


Let  Q  *  [I  -  {\  e1/2  HK  HT  c1/2]  (3.45) 

Then  (3.44)  becomes 

XTQ^>0  (3.46) 

Since  Q  is  a  real  symmetric  matrix  (3.45)  is  just  the  statement  that 
Q  is  positive  definite.  Now  a  necessary  and  sufficient  condition  on  Q 
to  be  positive  definite  is  that  all  its  eigenvalues  be  strictly  greater 
than  zero.  This  Implies  (See  Strang  [13]), 

(3.47) 

*(S(N+1))<  4>rf(N)). 
As  the  mappings  (3.15),  (3.23)  and  (S)  are  continuous  and  since  5* is 
bounded,  the  global  convergence  theorem  in  [12]  guarantees  that  any 
convergent  subsequence  of  the  sequence  ^(N)  converges  to  a  point  mini¬ 
mizing  <>(S)  on  £  >_  0.  By  strict  convexity  this  point  is  unique 


Maximum  eigenvalue  of  (e1^2  HK  HT  e1^2)  <  2 

jj 

Thus  assuming  (3.47)  is  valid,  as  long  as  IF  t  0, 
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and  the  sequence  S(H)  converges  to  it.  Thus  (3.4)  is  satisfied  and 
hence  convergence  of  the  algorithm  is  guaranteed.  QED. 


3.6  Comments  on  the  Distributed  Algorithm 

The  algorithm  presented  in  this  chapter  is  a  reasonable  and  easily 
Implementable  flow  control  algorithm.  However,  it  has  two  major  draw¬ 
backs  which  are  discussed  below. 


(1)  Convergence  of  the  algorithm  Is  only  guaranteed  if  condition 
(3.47)  holds.  Let  us  temporarily  assume  K  *  kl,  then  (3.50) 
becomes : 

Maximum  eigenvalue  (e1^2  HHT  e1^2)  <  (2/k)  (3.48) 


Now 


where, 


‘  it  hij  hjk- 

k=l 


(3.49) 


Hence  W  is  a  real  symmetric,  where  W^j  represents  the 
number  of  users  who  utilize  both  link  i  and  link  j. 


It  is  well  known  (see  Strang  [13])  that  the  maximum  eigenvalue  of 
a  matrix  Is  always  less  than  the  maximum  row  sum.  Using  this  fact  and 
(3.49)  condition  (3.48)  becomes: 


<  (2/k) 


(3.50) 
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Now  assuming  £j  <  (2/k) 


1  <  J  <  N, 


ei  <  “Tn 


(2/kI 


$  ‘ J 


•  ? 


(3.50)  is  satisfied  if 


(3.51) 


Thus  (3.51)  states  that  each  link  i  must  somehow  determine  the 


quantity: 


.  Hence  each  user  who  utilizes  link  i 


must  inform 


link  i  of  the  total  number  of  links  which  it  utilizes  in  its  route.  This 
would  be  done  at  time  of  call  set-up. 

If  we  assume  6.  <  (2/k  W.J,  1  <  j  <  N,  (3.50)  is  satisfied 

J  •  J  *" 


if 


(3.52) 


In  this  case  each  user  who  utilizes  link  i  must  inform  link  i 
of  all  the  other  links  which  it  utilizes  in  its  route. 

However  with  restrictions  (3.51)  or  (3.52)  the  algorithm  is 
no  longer  completely  distributed  since  each  link  must  know  a  certain 
amount  of  information  concerning  the  utilization  of  the  other  links 
in  the  network. 


(2)  The  major  drawback  of  the  algorithm  is  that  it  does  not 
treat  all  network  users  in  the  same  manner,  even  if  they  have  the  same 
e^'s.  This  can  be  observed  by  noting  that  the  rate  of  a  particular  user 


say  Uj,  is  a  function  of  the  quantity:  ^  Sk,  namely  the  cost  of  u^'s 

keLj 

route.  Clearly  the  more  links  In  user  Uj's  route  the  more  likely  It  Is 
to  have  a  higher  assigned  cost,  and  thus  by  Fig.  3.2  a  lower  assigned 
rate.  Hence,  the  algorithm  penalizes  those  users  who  require  many  links  to 
construct  their  route,  which  contradicts  the  standard  policy  of  voice 
communication  networks  (e.g.  the  connton  carrier  telephone  network). 

As  a  result  of  the  preceding  two  drawbacks  we  terminated  work  on 
this  algorithm  in  an  effort  to  develop  an  algorithm  which  would  be 
completely  distributed  and  completely  "fair"  to  all  network  users. 

3.7  Example 

We  conclude  this  chapter  with  a  simple  example.  Consider  the  network 
in  Fig.  3.4 


link  1 

effective  capacity  =  c1 


V 


link  2 

effective  capacity  *  Cg 


Figure  3.4  Simple  3  User,  2  Link  Network 
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Let  e^rj)  •  -(rj  -  r|Jax)2  j-  1,2,3 

and  r^8*  «  C  3  5  1.2,3 

Then  -j*  3  »  -  2{r*j  -  c) 

j 

By  (3.11) 

9j(rj)  •  -  Urs  -  c) 

and  by  (3.13) 

d*>x  *  2c  ,  Jj1n  =■  0 
Hence  (3.14)  and  (3.15)  gives  us 


r  42c:dj| 

for 

0 1  dj  i 

rj  l  r^J 

V® 

for 

d,  >  2c 

J 

Using  (3.12)  we  have 


J1 

* 

h 

* 


h  +si 

* 

S1 

* 

s. 


The  optimal  solution  of  (3.4)  is 


—I  ★ 

s  - 
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So  by  (3.17) 

r*  *  c/3 
r*2  s  2c/3  ~ 
r*  »  2c/3 

The  proceeding  example  clearly  shows  that  the  rate  assignment  for 
a  particular  user  depends  upon  the  number  of  links  which  the  user 
uti 1 i zes . 
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CHAPTER  IV 

THE  FAIR  FLOW  CONTROL  SCHEME 


We  consider  -n  this  chapter  a  flow  control  scheme  which  has 
user  "fairness"  as  its  primary  objective. 

After  motivating  the  scheme  and  presenting  the  centralized 
algorithm,  we  demonstrate  its  equivalence  to  a  sequential  optimi¬ 
zation  problem.  The  distributed  algorithm  is  then  developed  and 
shown  to  guarantee  convergence  to  the  unique  user  rate  assignment 
given  by  the  centralized  algorithm.  The  chapter  concludes  by 
examining  extensions  of  the  original  algorithm. 
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4.1  Introduction 

In  this  chapter  we  develop  a  flow  control  scheme  which  is  based 
upon  a  reasonable  notion  of  fairness.  By  fairness  we  mean  that  the 
quality  of  service  that  each  user  receives  is  dependent  only  upon  the 
current  network  traffic  conditions  and  independent  of  the  actual  length 
of  the  user's  route  (measured  by  physical  distance  or  by  the  number  of 
links  used).  Furthermore  in  order  to  be  fair  in  an  economic  sense  we 
must  assume  the  amount  each  user  pays  for  network  service  Is  proportional 
to  the  amount  of  network  resources  it  utilizes.  A  familiar  example  which 
illustrates  this  viewpoint  is  the  common  carrier  telephone  network. 

At  first  thought,  one  can  easily  insure  fairness  by  assigning 
each  user  the  same  rate.  However,  in  a  network  with  different  users, 
utilizing  links  of  different  capacities,  it  is  improbable  that  such  a 
scheme  would  be  desirable.  A  second  approach  is  to  somehow  equally 
divide  the  network  resources  among  the  users  and  it  is  this  approach 
which  we  will  follow  in  our  development. 

4.2  Development  of  the  Scheme 

To  construct  a  flow  control  scheme  we  must  determine  the  policy 
which  governs  the  allocation  of  network  resources.  In  selecting 
appropriate  user  rates  two  basic  requirements  must  be  satisfied: 

(i)  the  steady-state  total  flow  on  each  link  must 

v 

not  exceed  the  effective  link  capacity 
(ii)  the  quality  of  each  user's  service  must  be  as 
high  as  possible. 


The  following  simple  examples  serve  to  motivate  the  development 
of  our  FAIR  RATE  assignment  scheme. 

Example  4.1 

Consider  the  simple  network  illustrated  in  Fig.  4,1 


link,  effective  capacity  *  c 


Figure  4.1  Simple  two  User,  one  Link  Network 


Since  our  primary  objective  is  fairness,  any  rate  assignment  other 

than  r^  =  r^  =  (c/2),  would  be  unfair  to  either  user  or  user  u 

*  *  *  ★ 

because  it  would  imply  either  r-j  <  r 2  or  r-j  >  . 


Consider  the  network  shown  in  Fig.  4.2 


Figure  4.2  Three  User,  two  Link  Network 
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r 


Let's  examine  a  few  cases  of  this  network. 

Case  1)  Let  *  c2  =  c 

£  it  ♦ 

Then  the  fair  rate  assignment  is  simply  given  by  ri  “  r2  *  r3  *  (c/2)’ 

This  particular  assignment  also  happens  to  achieve  full  utilization  of 

the  network  resources  (all  links  are  saturated,  l.e.  fj  ■  c1  ,  i  =  1.2). 

Case  2)  Let  Cj  *  c/2,  =  c 

In  this  case  one,  must  be  careful  of  the  order  in  which  user  rates 

are  assigned.  For  instance,  suppose  we  first  divide  up  the  resources 

*  * 

of  link  2  equally  among  its  two  users  (i.e.  r1  =  r3  =  (c/2)).  Then 

the  residual  capacity  of  link  1  is  equal  to  zero,  hence  since 

requirement  (i)  must  be  satisfied  this  implies  the  rate  assignment  for 
* 

user  2,  i.e.  r 2  is  equal  to  zero. 

Thus  even  though  we  have  achieved  full  utilization  of  the  network 
resources  we  have  arrived  at  an  unfair  solution,  since  user  u2  is 
blocked.  The  fair  rate  assignment  for  this  case  would  be  determined 
by  first  dividing  up  the  resources  of  link  1  equally  among  its  two 
users,  r*  «  r\  -  (c1/2)  -  (c/4),  then  assigning  r*  “  c2  -  r1  “  (3c/4). 

It  is  very  important  to  note  that  the  fair  rate  assignment  does 
not  imply  that  all  links  In  the  network  will  be  saturated.  To  illustrate 
this  point  consider  the  following  example. 


-54- 


Examole  4.3 

Consider  the  network  Illustrated  in  Fig.  4,3 


Figure  4.3  Two  User,  two  Link  Network 
Let  C.J  =  c2  =  c. 

Then  the  fair  rate  assignment  is  simply  r^  *  r^  *  (c/2).  Now 
note  that  the  steady  state  flow  on  link  1,  denoted  f*  *  r*  *  (c/2), 
and  hence  link  1  is  not  saturated.  However,  in  general  if  each 
link  i  has  at  least  one  user  which  utilizes  only  link  i,  then  the 
fair  rate  assignment  always  results  in  full  utilization  of  the  network 
resources . 

At  this  point  we  need  to  develop  an  algorithmic  approach  for  solving 
the  fair  rate  assignment  problem  for  general  networks.  Thus  we  formalize 
the  fair  rate  assignment  algorithm  as  follows. 

Definition  4.1  Let  *uj  be  the  set  of  users  who  utilize  link  j, 
i.e. 

ui  ■  * » 

M 

Note V  ■  U  \J.  (4  j  > 

J-l 

where,  U  denotes  union. 


Definition  4.2  Let  L^  be  the  set  of  all  links  used  by  user  u^,  1,e. 
Lk  *  {jlhjk  =  1} 


Definition  4.3  Let  Wj  *  the  number  of  users  who  utilize  link  j. 


Definition  4.4  Let  w^  *  the  number  of  users  who  utilize  both  link  j 
and  link  k. 

Then  the  Fair  Flow  control  algorithm  can  be  stated  as  follows: 


FAIR  FLOW  CONTROL  ALGORITHM  (A) 

Step  1:  Determine  the  link(s)  which  is(are)  currently  the  network 
bottleneck(s) .  This  is  done  by  finding  all  links  j*  s.t. 


ft*)1  ft)  VjM* 

Denote  the  set  of  all  such  links  by  J  ,  and  the  value 
Step  2:  Assign  all  users  who  utilize  a 

link  j*  e  J*  the  rate  y  , 

i.e.  r£  =Y  v  keL ,  V  j*e0* 

J 


by  Y 


(4.3) 


(4.4) 


Step  3:  Reduce  the  original  problem  by  eliminating  the  presence  of 
all  users  assigned  in  step  (2). 
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Thus  let 


*l r  * 

(V 

w  * 

-  u  Vi  } 

j*eJ* 

★ 

(4.5) 

L  * 

U  - 

•  « 
j*eJ* 

(4.6) 

cj  * 

{cj 

-  E  "jj.  Y> 

j*eJ* 

VJGL 

(4.7) 

wj 

{WJ 

-  £  «jj.) 

i*eJ* 

V.eL 

J 

(4.8) 

Step  4.  Repeat  steps  ( 1 ) , (2)  and  (3)  until  all  users  have  been  assigned  a 
rate,  i.e.  until  v  -  {0}  . 

Some  important  properties  of  this  algorithm  are  as  follows: 

(1)  We  consider  the  algorithm  to  be  fair  because  the  rate 
of  each  user  is  greater  than  or  equal  to  the  rate  of 
all  users  that  share  its  bottleneck  link. 

(2)  By  the  way  we  assign  rates  we  are  guaranteed  that  each 
link  will  have  a  steady-state  flow  which  does  not 
exceed  the  effective  link  capacity  of  the  link. 

(3)  The  rate  assignment  is  unique. 

(4)  At  each  iteration  of  the  procedure  we  are  essentially 
maximizing  the  minimum  user  rate  by  equally  dividing 

up  the  resources  of  the  current  bottleneck  link(s)  among 
those  users  on  that  (those)  link(s)  (i.e.  the  set  J*) 
that  have  not  already  been  assigned  a  rate. 
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As  a  result  of  property  (4)  rates  are  always  assigned  in  order  of 
increasing  magnitude. 

Formally  this  can  be  shown  as  follows.  We  have  from  Step  1, 


fe) 

^  (v  )=  Y 

VJ* 

(4.9a) 

and  from  Step  3, 

A 

CJ 

■  ci  -  kj  V 

(4.9b) 

A 

Wj 

■  vrk5 

VJ* 

(4.9c) 

where 

k3 

’  £  wj* 

j*eJ* 

.  VJ* 

(4.9d) 

then,  using  (4.9a)  in  (4.9b) 

h.  ,  ci V  >Y. 

Wj  wj  "  kj 

which  is  the  desired  property. 

("J - ki> 
wj  ■  ki 

V  °* 

(4.9e) 

The  latter  property  of  the  algorithm  allows  us 

formulate  the  fair 

rate  assignment  problem  as  the  following  iterative  optimization  problem. 

• 

FAIR  FLOW  CONTROL  ALGORITHM  (B) 

Step  1 

Max  z 

(4.10a) 

S.t. 

rjiZ 

V  j  z\/ 

(4.10b) 

£  hij  rj  i  C1 

JcLT 

Vic  L 

(4.10c) 

r .  >  0 

J 

V  j  eV 

(4. lOd) 

The  solution  to  this  problem  Is  a  set  of  user  rates  denoted  { r^}  and 
resultant  link  flows  {f*}  where. 


f<  a  hH  r. 

1  j elf  J 

(4.11) 

Step  2 

Let  V*  »  ^ujlrj  *  z) 

(4.12) 

Assign  all  users  u.eU*  the  rate  z. 

J 

Step  3  Reduce  the  original  problem  as  follows 


Let:  L  - 

<j|fj  -  Cj) 

(4.13) 

then: 

V  = 

{V  -v/) 

L  * 

(L  -  L*) 

(4.15) 

cj  ■ 

Cj  -  £  > 2  v  j  u 
kcL 

(4.16) 

V 

wo  -  L  wjk  v  j  tL 

3  kel* 3 

(4.17) 

Step  4  Repeat  steps  (1),  {2)  and  (3)  until  all  users  have  been 
assigned  a  rate,  l.e.  until  \/  =  (0)  . 


Let  us  now  present  one  final  example  to  Illustrate  the  application  of 
the  general  fair  flow  control  algorithm. 

Example  4.4  Consider  the  network  shown  in  Fig.  4.4. 
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Step  IB 


Step  2B 


w 


2 

J* 


8c  C1  He 

T ?  *  T 


{2} 

c2  2c 
=  3  * 


Step  3B 


Step  4B 


L 

C1 

w, 


=  {1} 

=  C1  -  Y 


He 

6 


=  W,  •  1  «1 


w 


1 


7c 

6 


4c 

6 


7c 

6 


All  users  have  been  assigned  rates. 


The  flow  control  algorithm  that  has  been  developed  in  this  section 
Is  classified  as  a  centralized  algorithm  since  all  information  about 
the  network  and  users'  requirements  must  be  collected  in  a  central 
facility  which  first  carries  out  the  algorithm  and  then  broadcasts  the 
results  to  all  users.  Thus,  we  will  call  this  algorithm  the  Centralized 
Fair  Flow  control  algorithm. 


4.3  Distributed  Algorithm 

In  developing  a  distributed  (decentralized)  version  of  the  Fair 
Rate  assignment  algorithm,  we  will  follow  our  discussion  of  distributed 
algorithms  presented  in  Section  3.3.  Thus  we  associate  with  each  network 
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link  i  a  control  value  which  we  denote  by  p..  To  determine  the  distribu¬ 
ted  algorithm  we  must  specify  the  control  value  update  equations  and  the 
user  rate  assignment  relationships. 

« 

Two  observations  regarding  the  Fair  Rate  assignment  algorithm 
given  in  the  preceding  section  provide  us  with  valuable  insight  into 
how  the  desired  relations  may  be  derived.  They  are  as  follows: 

(I)  the  steady-state  rate  of  each  user  is  determined  by  its 
bottleneck  link  only, 

(II)  the  steady-state  rates  are  always  assigned  in  order 
of  increasing  magnitude. 

With  the  preceding  observations  in  mind  we  let  pi  represent  the 
maximum  rate  in  (bits/sec)  at  which  link  i  allows  all  its  users  to 
transmit.  Since  each  user  may  utilize  several  links,  we  set  the  rate 
of  each  user  to  the  minimum  control  value  over  all  links  in  its  route. 

More  formally,  we  have: 

r.  =  min  p.  1  <  k  <  M  (4.18) 

jeik  J  -  - 

Next  we  must  specify  the  link  control  value  update  equations. 

The  individual  objective  of  each  link  is  to  determine  the  rate  for  its 
users  such  that  the  link  may  become  saturated.  Each  link  makes  control 
decisions  based  upon  local  information  only,  hence  it  must  always  "assume" 
that  it  has  control  over  all  its  users  (i.e.  that  changing  its  p  will 
affect  its  users'  rates),  whereas  in  actuality  it  may  not.  So  basically 
p^  (old)  is  chosen  with  the  assumption  by  link  i  that  p^(old)  f^(old) 
s.t.  f^(old)  *  c^.  If  indeed  f^(old)  =  c^  then  link  i  is  satisfied 
and  it  sets  p^(new)  *  (old) . 
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However  If  f^(old)  f  c.,  then  link  1  must  assume  It  has  made  an 
error  In  the  selection  of  (old)  and  distribute  this  error  equally  among 
Its  users.  This  leads  us  to  the  desired  relationship  defined  as  follows: 

Definition  4.5  Associated  with  each  link  i  there  is  a  link  control 
value  update  equation  defined  as  follows: 

(new)  *  (old)  +  E-  [ci  -  f^old)]  l<i<N  (4.19) 


To  get  a  mapping  from  p.(old)  -*•  p^  (new)  we  must  express  f^old) 
in  terms  of  p..(old),  which  can  be  done  in  two  steps  as  follows, 

(i)  From  (3.11)  we  have 

M 

f* (old)  =  E  h4.  r .(old)  (4.20) 

1  j=l  J 


(ii)  From  (4.18)  we  have 

Mold)  =  min  pt  (old)  (4.21) 

So  substituting  (4.21)  into  (4.20)  and  the  resultant  into  (4.19) 
we  obtain  the  desired  mapping 

M 

p^(new)  *  (old)  +  — -  [c^  -  E  [min  pk(old)JJ 

l  j*l  kcl^ 


(4.22) 
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To  examine  how  the  distributed  algorithm  operates  let  us  consider 
applying  It  to  example  4,2  case  (2). 

Let  pi(0)  -  c/8,  p2(0)  =  c/4,  (can  be  arbitrarily  chosen) 

from  4.21  we  have 

r2  (N)  s  P-!  CN) 

r1  (N)  *  Min  [p-j  (N) ,  p2(N)] 

r  (N)  «  P2(N) 

w 

Now  using  (4.19)  and  (4.21) 


Increment  (N) 

P-j  (N) 

p2(n) 

r-j(N) 

r2(N) 

r3(N) 

0 

c/8 

c/4 

c/8 

c/8 

c/4 

1 

(c/4)* 

9c 

T5 

(c/4)* 

(c/4)* 

9c 

T5 

2 

(c/4)* 

2c 

37 

(c/4)* 

(c/4)* 

21c 

32“ 

3 

(c/4)* 

45c 

53“ 

(c/4)* 

(c/4)* 

45c 

53“ 

4 

(c/4)* 

93c 

T33 

(c/4)* 

(c/4)* 

(*)  desired  steady-state  value  achieved 

3  c 

Note  that  lim  p?(N)  r~  .  hence 
N-*»  d 

r!  *  11m  r3(N)  *  jp 
0  i+*» 

This  example  Illustrates  an  important  property  of  the  algorithm. 

Note  that  those  users  which  have  the  lowest  steady-state  rate  (i.e.  UpU3) 


converge  to  that  rate  in  a  finite  number  of  iterations.  However,  the 
rate  of  user  u3,  i.e.  r3  converges  to  its  appropriate  steady-state  rate 
only  in  the  limit  sense.  The  reason  being  that  link  2  never  learns  that 
the  rate  of  user  u2  is  being  controlled  by  link  1.  To  make  this  point 
clear  consider  the  following. 

From  the  preceding  example  we  have: 

r2(l)  =  r*2  =  c/4 

p2(2)  »  p2(l)  +  1-  tc2  -  f2(l)> 

•  (9/16)c  +  jL(c  -  <£♦  ^c)> 

»2<2>  '  T6  »  +  ^ 

In  our  present  formulation  w2  is  a  fixed  constant,  however,  let  us 
temporarily  assume  that  it  could  be  a  variable,  denoted  w2>  Furthermore 
let  us  assume  that  link  2  was  somewhat  informed  that  the  rate  of  user  u2 
was  fixed  by  link  1,  and  thus  link  2  knew  it  had  control  only  over  one 
user,  namely  u^.  Then  link  2  could  set  w2  =  1  and  hence 
P2( 2)  *  [9  +  3]  =  ^  which  implies  r3(2)  =  ^  *  r3»  Unfortunately 

such  a  procedure  would  require  a  great  deal  of  network  coordination  and 
more  overhead  information.  Since  in  general  each  fixed  user  would  have 
to  Inform  all  links  which  it  utilizes  that  it  is  indeed  fixed.  Thus 
we  will  maintain  our  original  algorithm  formulation  and  accept  the  fact 
that  In  general,  except  for  some  users  at  the  lowest  level,  all  steady- 
state  user  rates  are  achieved  in  the  limit  sense. 
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4.4  Proof  of  Convergence 

In  order  to  prove  convergence  we  must  show: 

lim  r,(n)  *  r*  1  <  i  <  M  (4.23) 

N-®  1  1  ~  " 

* 

where;  r.  is  the  rate  assignment  for  user  given 

by  the  Centralized  Fair  Flow  control  algorithm 

The  desired  proof  can  be  carried  out  by  introducing  the  notion  of 

4»  h 

rate  assignment  levels.  At  the  i  iteration  of  the  centralized  algorithm 

a  subset  of  links  are  found  to  be  the  current  network  bottlenecks 

★  ★ 

{i.e.  J  }  .  Then  each  user  who  utilizes  a  link  k6J  ,  and  has  not  been 

assigned  a  rate,  is  assigned  a  rate  which  we  will  call  level  i,  denoted  v^. 

Property  (4)  of  the  centralized  algorithm  guarantees  that  v^  >  v^_p 

i  >  0.  We  will  examine  the  convergence  of  user  rates  in  order  to  increasing 

level  values.  Now  the  formal  proof  can  be  presented  as  follows: 


Definition  4.6  Let  W.(v.)  represent  the  number  of  users  utilizing  link  j 

w  * 

who  have  a  steady-state  rate  at  least  as  large  as  v^  in  the  centralized 
algorithm. 


i.e.  W.(v.)  =  £  (1)  (4.24) 

uk6Mj 


vi 

Definition  4.7  Let  p4  represent  the  ideal  desired  control  value  for 
link  j  at  level  i 


Wj(v15 


-E 

r*<vi 


(4.25) 
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Note  that  If  the  final  value  of  p.  in  the  centralized  algorithm 

\j  _  <3 


Is  Vr,  then  Pjr  .  rf-j 

J  * 


1 


ci  "  ^  rk 

rk  <  vr 


and  Wj (vr+1 )  *  0. 


Theorem  4.1 


V  i. 

V6.  >  0, 

3N 

s.t.  V  n  >  N 

(A) 

v, 

Pj(n)>  Pj 

6i 

(4.26) 

(B) 

lrk(n)  -  r*| 

<£i 

Vk  s.t.  rk _<  vi 

(4.27) 

Theorem  4.1(B)  states  the  convergence  of  the  distributed  algorithm. 


Proof  of  Theorem  4,1 

The  proof  proceeds  by  induction 

Let  i*l; 

(A)  Note:  W.(v.)  =  Wi 

By  (4.22)  we  have  for  all 

Pj  (n+1)  =  p.(n)  +  r-[cj  - 

Since 

rk(n)£Pj(h)  u 


on  i 


1 

<  j  <  N 

(4.28) 

n  ^  0, 

E 

rk<n>]  '  Vj 

(4.29) 

ukeuj 

:8VJ  . 

Vj 

(4.30) 
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Pj(n+D  -  pj(n)  +  fjj  Ccj  -  Wj  Pj (n)  ]  *  Jjj  ,  Vj 
Hence; 

cj  ci 

P.,  (n+l)  £  tr-  >  min  rp  =  v  V- 

3  Wj  “  j  Wj  1  3 

(which  is  the  desired  result). 


(4.31) 


(4.32) 


(B)  Assume  r*  =  v1 

rk(")>r*  -  6, 

rk(n)<r*  +  6, 

(4.33) 

rk(n)  £  Vt  =  r*  V  n>o. 

Hence  (1)  is  true  after  one  step. 


We  must  show; 


(1) 


(2) 


Case  (1) 


rk(n)  =  min  pm(n) 


m€L 


However  by  (4.32) 


Case  (2)  We  would  like  to  show  that 

rk(n)  £  rk  +  61  (3.34) 

Assume  that  there  exists  a  user 

uk  s,t>  rk^^  >  rk  +  61 
and  find  a  link  j  6  L  s.t.  p*  s  v,  . 

K  J  i 


(4.35) 
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We  show 


Kj("+1)  <  Pjtn)  -  jjjfc-j. 


as  follows. 


by  (1)  rk(n)  >_  v1 


vn>0 


However 


(4.36) 


r 

Pj("+1>  -  Pj<»>  *  OCT  V  E  rk(n)  (4.37) 

j  i  ukbUj 


Pj("*D  <  Pjtn)  +  m-  [Cj  -  (Mj  (»,))*,  -  £,]  (4.38) 

'pj‘n>+(w^T  -vi)  ’  w^T  <«•»> 

*  v-j  ,  thus  (4.39)  becomes 
j  1 

Pj(n+1>  <  Pjtn)  -  <  Pjtn)  -  (4.40) 

which  Is  the  desired  result  . 


(4.40) 


Hence  as  long  as  rk(n)  i  rk  +  Pj  1s  going  to  decrease  by  an  amount 
greater  than  ,  thus  there  exists  a  time  when  the  inequality  (4.35) 

becomes  reversed,  i.e. 


3N  s.t.  rk(N)  <  rk  +  61 


(4.41A) 
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Now  assume  that  e1  <  second  smallest  (^-)  -  v^. 

j 

We  can  now  show  that  Vn^  N.  conversation  k  is  controlled  by  a 

link  j  with  Pj(n)  <  r£  +  and  pj  =  r£,  so  that  rk(n)  <_  rk  + 
which  is  the  desired  result.  Assume  link  j  does  it  at  time  n.  Then 

Pj("+1)  *  Pj(">  +B7  cj  •  £  r*<n> 

■  Pj(">  +  H7  cj  -  E  rm<n>  -  Pj("> 

J  L  “rfu4  J 


by  (1)  rm(n)  1  vl  =  pj  >  thus , 

Pj(n+1)  <  Pj(»)  (l  -  r)  ♦  JT 

J  J 

Now  since  link  j  controls  user  k,  we  have: 

* 

Pj(n)lrl(  +  el  Thus» 

★ 

Pj(n+1)  £  +  «,)  O  -  Jr:)  ♦  Jr  ■  r*  ♦  e,  -  J- 

J  3  J 


Hence, 


3N  s.t.  rk(n)  <  rk  +  e] 


V  n  >  N 


(4.41B) 


as  desired.  Moreover  the  link  &  controlling  k  at  time  n+1 

c , 

has  p^(n+l)  i  rk  +  ei  <  second  smallest  (^-)  and  thus 
P1  =  vi  by  (4.32) . 
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In  fact  the  algorithm  guarantees  that  at  least  one  link  which 
has  a  steady-state  control  value  equal  to  v^,  will  converge  to  that 
value  in  a  finite  amount  of  time.  This  can  be  shown  as  follows. 

Find  a  link  j  and  a  time  such  that 

Pj *  min  P^),  p!  *  v1  (4.42) 

m  J 

Such  a  link  and  time  must  exist. 


Claim:  p^(N,  +  1)  «  p* 

“  J  ]  J 

Proof: 

Pj(N1+l)  =  pj(V  +  wTTvTy 

J  * 

=  pi(Nl)+H^7 

* 


c,  -  12  rk(N,) 

3  k  6  TJ-. 

J 


W_-  (vt  ) 


(4.43) 


(4.45) 


(4.46) 


Thus  all  users  who  utilize  link  j  will  converge  to  their  steady-state 
rate  in  a  finite  number  of  steps. 

Inductive  Step 

Reset  time  origin  to  0. 

Thus  assume  at  n»  0,  .(A)  and  (B)  are  satisfied  at  level  i-1 

with  G._.j 


as  specified  below. 
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We  now  show  that  (A)  and  (B)  are  satisfied  at  level  i 
(A)  Two  cases  to  consider: 


<»  pj >  vi-\ 

(in 


★ 

Case  (I)  Assume  >  v._-j 

Pjd)  ■  Pj(°)  |cj  - 


r,(0) 


k 

rk<vi-l 


>  Pj(0)  +  ^ 


2 


_  r.  (0) 
\G^j 
rk>vi 


(4.47) 

(4.48) 


(4.49) 


CJ  ‘  rk  '  (“r“o(vi))6i-l  •  “j(,i)Pj(0) 

uk  ® '■/i 

(4-50J 


wi  -  W 


Pj(°)  - 


Wi  -  Mi^1> 


6i-i +  -V-  pj'i 

J 


(4.51) 


Where  the  inequality  (4.50)  holds  because  by  Theorem  4.1(B) 


rk(0)  <  rk  +  6._1  , 


rk  i  vi-l 


and  because  rk(0)<Pj(0),  ukeiJj 


Now  for  notational  convenience  let 

& 


W,  -  Wj(v .) 

1  ff  -3— 


'j 


(4.52) 
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P*  and  the 

desired  result  is  already  proved ! 

Thus  (A)  Is  proved  for  i. 

(B)  Assume  r*  3  and  n  >  N 

r.  (n)  =  min  p.(n)  £min 
3  JGLk 

where  the  latter  inequality  results  from  (A). 

vm  * 

Lemma  4.1  at  the  end  of  this  section  shows  that  >vi  if  p^  > 

VM  —  vi ' 

v^ 

Thus:  min  p.1  >  v. 

oak  »  ~ 


*  vi  V 

Case  (II)  Assume  pj  £  then  Pj  =  Pj 


i-1 


(4.61) 


(4.62) 


- — 

,  '  '  .  ... 
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Using  (4.61 )  and  (4,62)  we  have  shown  that 

pk<n>  i  vi  -  zsj  t  vi  -  6i  (4-63) 

as  desired. 


Now  we  need  to  complete  the  desired  proof  by  finding  an  N  >  N'  such  that 


rkM  I  rk  +  ei 


V  n  >  N 


(4.64) 


Assume  there  exists  a  user  uk  ,  with  rk  =  s.t.rk^  >  rk  +  6i*  n  >  N 
and  find  a  link  jSLk  such  that  p*  =  vr  Such  a  link  must  exist. 


Ue  show: 


Pj(n+1)  <  pj(n)  - 


(4.65) 


Pj(n+1)  *  Pj(n)  +  y- 


c,-  - 


m  j 
m  t  k 


rm<"> 


-  ru(n) 


(4.66) 


By  Theorem  4.1  (A)  and  Case  (I);  rffl(n)  >rffl 

-  ei/2Wj* 

V  “m  i  vi 

Pj(n+1)  <  Pj(n)  +  [o  +  rk  +  Wj 

-rk(n)1 

(4.67) 

i  pj(n)  *  ^  [t- -  «1 1 

(4.68) 
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Then 


Pj(n+1)  <  Pj(il)  -  jjU 

V 

Hence  as  long  as  rk(n)  >_  rk  +  6^ 


(4.69) 


Pj  is  going  to  decrease  by  an  amount  greater  than 


thus  there 

must  exist  a  time  N,  when  the  inequality  (4.67)  becomes  reversed,  i.e. 


3N 


s.t.  rk(N)  <  rk  +  6. 


(4.70A) 


v.+l  -  v. 

Now  assume  that  6..  <  [ - g - -]  .  At  time  N  user  k  must  be  controlled 

★ 

by  a  link  j  such  that  p.  =  v.. 

J  * 

We  now  show  that  Vn  >  N,  user  k  is  controlled  by  a  link  j  with 

*  *  *  * 

Pj(n)  <  rk  +  6.  and  *  rk  ,  so  that  rk(n)  <  rk  +  which  is  the 

desired  result. 


Pj(n+1)  -  Pj(n)  +  J-  [cj  -  u  S  rm(n)  -  Pj(n)] 

J  in'"  -S 


m  j 
m^k 


By  (4.63)  r„W>r*-^  ,  thus 

J 

l  *  6i- 

Pj(n+1)  <  Pj(n)  +  [rk  +  W^  (jjg-)  -  Pj(n)] 

J  J 

1  rk  €i 

-  Pj(n)  0  -  r)  +  wT  +  2W7 

J  J  J 

Pj(o)  <  (rk  +  6i  ) 


We  know: 
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Hence, 


p4(n+1)  -  {rk  +  G1}  (  1  “  ^  +  WT  +  55T 


*  i 

"  rk  +  61  •  ZWJ 


So,  Pj(n+1)  <  rk  +  Gi 


as  desired.  Thus  at  time  n+1,  user  k  is  controlled  by  a  linl 
pj(r*l)  <  r*  +  e,  . 

Thus, 

3N  s.t.  rk(n)  <_  rk  +  G.  ,  Vn  >  N 
Combining  (4.63B)  and(4.70B)  we  get 

lrk(n)  -  r£|  <  G.  Vk  s.t.  r*  <  vi 

and  thus  convergence  is  proved.  Q.E.D 


We  now  prove  the  lemma  mentioned  previously. 


I 


j  with 


(4.70B) 
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Lemma  4.1  If  >_ 


Then  p™  >_ 


for  vm  >  v4 
m  —  i 


Proof  of  Lemma  4.1 


Assume  Pj  >_ 

let;  E  <> 

Uk6uj  ukGuj 

rk<vm  rk-vm 


vm  —  V1 


(4.71) 


Cj 


‘  ^r1" k  -  ^  rk-vm  Wi(vJ  >  vi  MO  (4.72) 

u.G^/.  u.GU  K~  mj  m  —  i  j  m 


y  ~  j  y 

rk<vm  rk-vm 


Cj 


Yvj 

rk<vm 


±vi 


(4.73) 


Hence 


pj"  i  vi 


V  vm  >  v. 
m  —  1 


(4.74) 


which  Is  the  desired  result  . 
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4.5  The  Jaffe  Scheme 

While  this  research  was  in  progress  J.M.  Oaffe  [14]  published 
interesting  results  on  a  flow  control  algorithm.  The  objectives  of 
Jaffe's  scheme  are  quite  similar  to  ours,  as  presented  in  section  4.2, 
however,  he  introduces  the  following  new  idea. 

Instead  of  choosing  user  rates  in  a  fair  manner  such  that; 

(Cj*  -  f*)  -  0  (4.75) 

which  our  algorithm  does. 


select  user  rates  in  a  fair  manner  such  that 

{c*.  -  f*)  =  (max  r*)/x  (4.76) 

3  3  keL.  K 

J 

where  x  is  a  positive  constant. 

There  are  basically  two  reasons  for  using  (4.76), 


(i)  Assume  a  new  user,  say  u„  .  initializes  a  call. 

ncW 

We  know  that  the  rate  allocated  to  it  must  be 
determined  by  the  bottleneck  link  on  its  route, 
and  thus  we  have 


rnew 


<  max 


★ 


Vj£i"new 


Now  if  x  =  1  in  (4.76)  we  have 


(4.77) 


.  *  *.  * 

(c.  -  f.)  =  max  r. 

3  3  keLi  * 

w 

Hence  we  can  accommodate  user  u 


new 


cj  <  7}  f»’-  fcw 


without  causing 


-79- 


(ii)  Using  (4-76)  protects  the  network  against  percentage 

changes  In  each  user's  rate  due  to  transient  conditions. 

Thus  if  a  user  increases  its  rate  by  a  factor  (1/x),  the 
*  * 

Inequality  c.  >_  f.  still  applies. 

J  J 

Oaffe  presents  an  algorithm  to  compute  the  user  rate  assignment. 
It  is  essentially  the  centralized  algorithm  presented  in  section  4.2, 
except  that 


Pj(i+D  - 


[  v  y> 

[l/x  +  Wj.(i) 


where  f - (i )  *  sum  of  the  rates  of  the  users  on  link  j 
J 

that  have  been  fixed  before  the  ith  iteration 


A 

w.(i)  *  the  number  of  users  which  have  not  been  fixed 

J 

by  the  ith  iteration. 

Of  course  this  algorithm  has  the  same  finite  convergence  property  as  all 
centralized  algorithms.  In  order  for  this  algorithm  to  be  distributed, 
the  following  is  required: 


(1)  Before  executing  the  algorithm  the  rate  of  each  user  must  be 
set  to  0. 

(2)  Each  link  j  must  keep  track  of  £( rates  fixed),  and  the 
number  of  users  unfixed. 

(3)  After  every  step  until  its  rate  is  fixed,  each  user  must 
inform  all  links  on  its  route  of  its  rate. 


Restriction  (1)  is  a  major  drawback  of  Jaffe's  algorithm  because 
it  essentially  implies  that  each  time  a  new  _ser  enters  the  system. 
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the  rate  of  each  user  already  active  in  the  network  must  be  set  to  zero 
in  order  to  carry  out  the  algorithm.  Clearly  this  is  not  desirable  for 
a  packet  voice  network. 

Restrictions  (2)  and  (3)  require  a  lot  of  cooperation  between 
each  user  and  the  links  in  its  route,  but  still  allow  the  algorithm  to 
be  decentralized  in  the  sense  that  the  rate  of  each  user  is  determined 
only  by  the  links  in  its  route. 

To  modify  the  algorithm  developed  in  this  chapter  to  use  Jaffe's 

objective  (4.76)  Instead  of  (4.75),  we  simply  need  to  introduce  the  notion 

of  a  fictitious  user  uc  for  each  link  j,  who  utilizes  only  link  j, 

Fj 

with  rate  :  rc  (N)  =  [p^(N)/x].  By  doing  this  we  are  essentially 

Fj  J 

reserving  enough  capacity  on  each  link  such  that  after  convergence  each 

link  j  is  able  to  accommodate  one  new  user  at  rate  p^/x  without  having 
*  * 

fj  >  c..  Hence  we  can  alter  our  algorithm  as  follows 

p  (new)  =  p.(old)  +  — — r  [c.  -  Mold)  -  p.(old)/x] 

J  J  Lwj  xj  J 

forl<  j<N  (4.78) 

Note  that  our  algorithm  under  these  changes  still  remains  completely 
decentralized.  In  addition  the  algorithm  as  before  is  incremental 
(i.e.  the  algorithm  converges  from  any  initial  p^O) )  and  thus  doesn't 
suffer  restriction  (1)  of  Jaffe's  algorithm. 

As  we  will  see  in  the  next  chapter  the  use  of  criteria  (4.76) 

Instead  of  (4.75)  leads  to  improved  performance  of  the  Fair  Flow  control 
algorithm  and  thus  Jaffe's  idea  is  of  significant  value. 


CHAPTER  V 

SIMULATION  AND  RESULTS 

In  this  chapter  a  computer  program  is  developed  to  simulate  a 
general  packet-switched  network.  The  program  monitors  every  packet 
generated  from  each  source,  thus  allowing  us  to  obtain  detailed 
measurements. 

We  first  develop  the  program.  Then  after  the  specific  network 
model  is  chosen,  we  examine  the  performance  of  the  algorithms  developed 
in  chapter  IV. 


5.1  Simulation  Model 

We  would  like  to  model  the  behavior  of  a  packet- switched  voice 
network  so  that  a  simulation  program  can  be  developed  to  determine  the 
performance  of  the  decentralized  Fair  Flow  control  algorithms  presented 
In  Chapter  IV.  To  develop  our  model  we  must  characterize  both  the  end- 
to-end  control  mechanism  and  the  source  operation. 

5.1.1  End-to-End  Control  Mechanism 


Each  link  j  In  the  network  will  measure  its  flow  over  a  time 
period  denoted  by  TOBS(j)  and  then  compute  its  new  control  value  using 
the  appropriate  update  equation.  The  necessary  control  Information 
can  be  transmitted  through  the  network  by  the  following  scheme. 

Each  source  generates  either  voice  or  control  packets.  The 
structure  of  these  packets  is  illustrated  in  Fig.  5.1 


Header 

Forward 

Control 

Information 

(FO) 

Voice  Information 


Fig.  5.1(a)  Voice  Packet  Format 


Fig.  5.1(b)  Control  Packet  Format 
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Let  us  denote  the  forward  control  Information  by  FO  and  the  feedback 
control  information  by  FE.  Furthermore,  let  us  assume  that  each  source 
u^  maintains  two  control  variables; 

(1)  SCNTRL  (1)  -  which  represents  the  current  allowable  total 
transmission  rate  for  source  1 

(2)  OCNTRL(i)  -  which  represents  the  feedback  rate  for  source  u^'s 
partner  across  the  network. 

Then  the  control  mechanism  works  as  follows.  The  value  of  FO  is 
initially  set  to  infinity.  Each  link  along  the  route  to  the  destination 
compares  FO  with  its  current  link  control  value  and  if  the  latter  is 
less  than  FO,  it  substitutes  that  value  for  FO,  otherwise  FO  Is  left 
unchanged.  When  the  packet  reaches  its  destination,  the  FO  field  will 
indeed  contain  the  minimum  current  link  control  value  over  all  links 
in  the  packet's  route.  The  destination  will  then 

(1)  read  FE  to  learn  the  rate  at  which  the  network  can 
support  its  transmission 

(2)  set  its  SCNTRL  =  FE 

(3)  read  FO 

(4)  set  its  DCNTRL  =  FO. 

By  carrying  out  the  procedure  discussed  above  the  necessary  control 
Information  will  be  continually  exchanged  between  the  two  ends  of 
the  conversation. 


5.1.2  Source  Operation 

Each  conversation  in  the  network  consists  of  a  pair  of  users  which 
alternate  between  talkspurt  and  silence  modes.  We  assume  that  if  users 
u-|  and  u 2  comprise  a  conversation,  the  completion  of  a  talkspurt  period 
of  user  u-j  Is  always  followed  by  a  talkspurt  period  of  user  u2,  and 
vice  versa.  Thus  we  do  not  allow  a  talkspurt  period  of  a  particular 
user,  say  u^,  to  be  followed  by  a  silence  period  for  both  u-j  and  u2  and 
then  another  talkspurt  period  for  u-j.  As  a  result  our  model  is  not  an 
exact  representation  of  conversational  speech,  however,  it  is  still  a 
reasonable  and  acceptable  model. 

The  behavior  of  each  source  at  any  given  time  is  dependent  upon 
which  mode  it  is  currently  in. 

I 

A.  Silence  Mode 

If  a  user  Is  in  silence  mode  we  assume  that  it  will  generate 
fixed  length  control  packets  periodically  with  a  time  period  denoted 
by  ICPINC.  The  length  of  the  control  packet  will  be  denoted  by  LENCON 

B)  Talkspurt  Mode 

If  a  user  is  In  talkspurt  mode  we  assume  it  will  generate  voice 
packets  at  an  average  rate  of  50  (packets/sec.),  or  equivalently  a  voice 
packet  Is  generated  approximately  every  20  milliseconds  (which  is  the 
value  most  commonly  used  In  practice).  In  order  to  introduce  some 
additional  randomness  the  actual  time  period  between  voice  packet  gene¬ 
ration  will  be  represented  by  a  sample  from  a  uniform  distribution  defined 


over  the  range  [18,22]  mill i seconds. 

The  length  of  the  generated  voice  packet  is  dictated  by  the  source's 
current  control  value,  i.e.  SCNTRL.  Thus  we  determine  the  length  of 
the  entire  voice  packet  by  the  relationship 

Total  voice  packet  length  -  [^"(peckets^sw!)]  *  <b1t5/packet). 

(5.1) 

Since  each  voice  packet  must  contain  a  fixed  number  of  bits  (for 
header  and  control  information),  the  actual  rate  at  which  voice  information 

is  being  coded  is  given  by  the  relationship: 

Voice  Coding  Rate  *  SCNTRL  -  50  (packets/sec)  LENCON (bits/packet)  (5.2) 

=  [SCNTRL  -  50  (LENCON)]  (bits/sec)  (5.3) 

To  model  the  creation  of  a  talkspurt  period  we  must  first  determine 
the  number  of  voice  packets  a  user  will  have  to  transmit.  This  can  be 
determined  by  finding  the  particular  duration  of  the  talkspurt  period. 

The  probability  distribution  of  conversational  talkspurt  and  silence 
durations  were  measured  by  Brady  [15],  and  these  measurements  can  be 
used  as  the  basis  for  a  statistical  model  for  talkspurt  duration.  The 
standard  statistical  model  used  is  to  represent  talkspurt  duration  as  an 
exponential  random  variable  with  mean  value  equal  to  1.2  seconds.  Thus 
If  t  represents  a  sample  from  this  distribution  then  the  number  of 
packets  a  user  will  have  for  its  talkspurt  is 
Number  of  voice  packets  for  talkspurt  * 

Integer  [50  (packets/se;)  x(seconds/talkspurts)]  +  1  (5.4) 
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where,  t  is  a  sample  from  an  exponential  distribution  with  mean  value 
equal  to  1.2  seconds. 

Having  completed  our  simulation  model  development  we  are  now  ready 
to  proceed  to  the  development  of  the  simulation  program. 

5.2  Simulation  Program 

A  simulation  program  (see  Appendix)  has  been  developed  on  the 
basis  of  Section  (5.1)  .  The  program  was  constructed  by  esentially 
noting  that  there  are  five  fundamental  events  that  can  take  place  in  the 
network.  Then  by  determining,  scheduling,  and  executing  these  events 
in  chronological  order  we  were  able  to  produce  the  desirable  model.  The 
five  events  are  discussed  below. 

(1)  Absorption  -  A  packet  is  absorbed  when  it  finally  reaches  its 

s' 

destination.  The  destination  receiver  then  reads  the  control 
Information  in  the  packet  and  updates  its  control  parameters. 
Furthermore,  If  the  packet  was  the  last  voice  packet  of  a  talkspurt 
then  the  destination  generates  its  talkspurt. 

The  packet  is  then  removed  from  the  presence  of  the  network  after 
a  small  receiver  processing  delay,  denoted  TPROC  (1). 

(2)  Arrival  -  A  packet  arrives  at  a  link  which  it  is  to  be  transmitted 
on.  The  size  of  the  link  queue  is  increased  by  1.  There  are  two 
cases  to  consider.  When  the  packet  arrives  at  link  j  it  either 
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(a)  finds  the  queue  for  link  j  empty 

(b)  finds  the  queue  for  link  j  non-empty. 

If  (a)  occurs,  then  after  a  small  link  processing  delay,  denoted 
TPR0C(2)»  the  packet  is  scheduled  for  transmission. 

If  (b)  occurs  then  packet  is  placed  at  the  end  of  the  link  queue. 

(3)  Transmit  -  When  a  packet  is  to  be  transmitted  on  link  j  the 

following  sequence  of  steps  must  be  executed. 

(a)  Determine  the  next  location  for  the  packet.  The 
next  location  will  either  be  another  link  or  the 
destination  receiver. 

(b)  Determine  the  amount  of  transmission  time  it  will 
take  to  transmit  the  packet. 

(c)  Perform  appropriate  data  manipulation  upon  the 
packet's  control  data  field,  using  link  j's  current 
control  value. 

(d)  Using  (b),  the  value  for  link  j's  propagation  delay, 
denoted  TPR0P(j),  and  the  link  processing  delay,  denoted 
TPROC (3) ,  schedule  the  packet  at  the  next  location  which 
was  determined  in  (a). 

(e)  Eliminate  the  presence  of  the  packet  from  the  link  j 
queue  after  a  time  period  equal  to  [packet  transmission 
time  +  TPROP (j)]  has  elapsed. 


(4)  Packet  Generated  at  Source 


A  packet  generated  at  each  source  u^  Is  either: 

(a)  a  control  packet  if  the  source  is  currently  In 
silent  mode 

(b)  a  voice  packet  if  the  source  is  currently  In  talkspurt 
mode. 

For  (a)  the  following  sequence  of  steps  must  be  executed; 

(i)  The  packet  length  is  set  to  a  constant  value  equal 
to  LENCON. 

(ii)  The  forward  control  information  field  is  set  to  •  . 

(iii)  Feedback  control  information  (i.e.  DCNTRL(i) )  is 
placed  in  the  packet  for  use  by  the  destination. 

(1 v)  The  packet  is  scheduled  to  arrive  at  the  first  link 
in  its  route  after  a  source  processing  delay  denoted 
TPR0C(4). 

For  (b)  the  following  sequence  of  steps  must  be  executed: 

(i)  Determine  whether  or  not  the  packet  is  the  last 
voice  packet  of  the  source’s  talkspurt. 

(11 )  Determine  the  length  of  the  packet  as  a  function  as 
per  (5.1) 

(iii)  Schedule  the  packet  to  arrive  at  the  first  link  in 

its  route  after  a  source  processing  delay  of  TPR0C(4). 

(iv)  Decrement  the  number  of  packets  remaining  in  talkspurt. 


(5)  Link  Control  Value  Update  -  Each  link  j  measures  its  average  flow 
over  the  observation  period  TOBSU).  At  the  end  of  this  period  It 
updates  its  control  value  according  to  the  appropriate  link  control 
value  update  equation. 

The  next  link  control  value  update  is  then  scheduled  for  T0B$(j) 
seconds  in  the  future. 

The  simulation  program  uses  two  tables,  ETABLE  and  PACKET,  to 
continually  execute  the  five  different  types  of  events  in  proper  chrono¬ 
logical  order.  In  addition  provision  is  made  to  periodically  compute 
statistical  information  regarding  the  links  and  sources  in  the  network. 

5.3  Network  Model  for  Simulation  Program 

In  order  to  have  a  basis  of  comparison,  we  choose  to  select  a 
network  model  which  resembles  that  used  in  the  (LL)  simulation  discussed 
earlier.  However  the  (LL)  network  model  [10]  consisted  of  800  sources, 
which  would  create  a  tremendous  computational  and  booking  load  for  our 
simulation  program  since  we  monitor  all  packets  generated  by  all 
sources.  Thus  we  chose  to  scale  the  network  by  a  factor  of  (1/10). 
Furthermore  the  (LL)  network  model  considered  traffic  flow  in  only  one 
direction  whereas  to  consider  to  examine  the  effects  of  important  delay 
parameters  (which  the  (LL)  simulations  did  not)  we  must  consider  two-way 
traffic  flow,  as  discussed  in  section  5.1.  One  way  of  modifying  the 
(LL)  model  to  allow  two-way  traffic  flow  without  adding  any  additional 
links  is  to  view  all  sources  as  being  at  the  same  location.  The  final 
network  that  will  be  used  in  our  simulation  is  illustrated  in  Figure  5.2. 


Receive 


Figure  5.2  Simulation  Network  Model 
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Each  used  i  is  paired  with  user  (Sl-i),  for  1  ^  i  <_  40.  Ideally 
we  would  like  no  correlation  between  the  set  of  links  which  user  i 
utilizes  and  the  set  of  links  which  its  partner,  namely  user  C81-1), 
utilizes  since  this  would  be  the  case  if  we  had  indeed  incorporated 
additional  links  to  support  ideal  two-way  traffic.  However,  notice 
from  Fig.  5.2  that  the  user  pairs: 


user 

32 

user 

49 

user 

31 

<r= 

user 

50 

user 

30 

user 

51 

user 

29 

<= 

=4 

user 

52 

are  indeed  correlated  since  each  pair  uses  link  7.  Thus  with  our  network 
model  we  do  not  achieve  complete  link  independence  of  user  pairs,  but 
because  only  link  7  is  involved,  and  only  8  users  out  of  a  total  of  24 
on  that  link  are  involved,the  consequence  should  be  negligible. 

It  also  should  be  noted  that  in  the  original  (LL)  network  the 
link  capacities  were  all  equal  to  0.40  mbits/sec,  however  since  we 
must  scale  down  by  a  factor  of  10,  the  true  capacities  of  all  link  in 
Fig.  5.2  will  be  set  equal  to  40  Kbits/sec. 

5.4  Results 

The  parameters  used  in  all  simulation  runs  were  chosen  to  be 
consistent  with  respect  to  current  technology.  They  are  as  follows: 

Overhead  Number  of  bits  per  packet  (LENC0N)  3  10  bits 

Control  packet  intergeneration  time  (I CP INC)  *100  milliseconds 

Receiver  processing  time  for  packet  Absorbtion  (TPROC(l))*  5x10”^  sec. 


Link  processing  time  for  packet  Arrival  (TPR0C(2))  =  5xl0~4  sec. 

Link  processing  time  for  packet  Transmission  (TPROC (3) )  =  1x10"^  sec 

Source  processing  time  for  packet  Generation  (TPROC (4) )  *  5xl0~*  sec 

We  used  as  the  effective  link  capacity  of  link  i  ,  (0.8)  times 
the  true  capacity  of  link  i.  Thus  the  effective  capacity  of  each  link  i 
was  equal  to  32  k  bits/sec.,  i.e. 

c.  =  32  kilobits/sec  for  1  <_  i  £  8 

Furthermore  the  propagation  delay  of  each  link  i  was  taken  to  be 
3  milliseconds,  i.e. 

TROP(i)  =  3  milliseconds  for  )<  i  <  8, 

For  simplicity,  we  assumed  that  the  time  period  between  control 
updates  for  all  links  will  be  identical,  however,  the  link  control 
updates  are  not  carried  out  synchronously  in  the  program.  Thus  let  us 
denote  T  =  TOBS(i),  for  1  i  8.  The  parameter  T  is  the  primary 
variable  of  concern  since  altering  T  over  a  range  of  values  can 
dramatically  change  the  performance  of  the  algorithm. 

T  =  20  ms 

Shown  in  Figure  5.3  is  a  plot  of  the  average  flow  (averaged  over 
the  previous  100  ms)  on  link  2  as  a  function  of  time.  The  dotted  line 
on  the  graph  portrays  the  number  of  active  speakers  on  link  2,  denoted 
by  N,  at  a  given  time.  The  flow  always  lags  N  because  of  the  presence 
of  delay. 

It  is  clear  from  Fig.  5.3  that  choosing  T  s  20  ms  leads  to 
oscillation  since  a  small  change  in  the  number  of  active  speakers  can  lead 


-93- 


to  a  large  change  in  the  resultant  link  flow.  The  occurence  of 
oscillation  is  due  to  the  fact  that  although  link  control  updates  are 
performed  every  20  ms,  the  time  period  between  source  rate  updates 
is  equal  to  at  least  100  ms  (i.e.  ICPINC).  Thus  if  link  j  controls 
user  u.. ,  then  r..(n)  5  Pj(n-4).  As  a  result,  source  rates  are  being 
assigned  on  the  basis  of  old  data  which  does  not  reflect  the  current 
network  status.  In  this  case  our  model  is  no  longer  valid  and  the 
control  update  algorithm  breaks  down.  In  conclusion  T  should  be  chosen 

more  comparable  to  the  maxinum  of  the  round  trip  delay  and  the  control 
packet  intergeneration  time. 


(Seconds) 
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T  »  100  ms 

A.  Quasistatic  Behavior 

By  examining  Fig.  5.4  we  see  that  the  algorithm  basically  does 
achieve  its  goal  of  keeping  the  average  flow  around  the  effective  link 
capacity  (i.e.  32  kilobits/sec).  We  also  observe  over  periods  of  time 
where  the  number  of  users  remains  more  or  less  constant,  that  the 
algorithm  takes  about  five  steps  (i.e.  500  ms)  to  yield  the  desired 
link  flow.  This  can  be  explained  by  noting  that  link  2  usually  has 
control  only  over  its  users  which  also  either  link  5  or  6  and  as  a 
result  we  expect  link  2  to  be  controlling  about  3  active  users  only, 
leading  to  decay  rate  a2(v3)  9^ven  by  (4.52)  of  about  (14/20),  and 
[a2(v3)]5  is  negligible. 


B.  Dynamic  Behavior 

To  obtain  a  basis  of  evaluation  of  the  dynamic  (short  term)  behavior 
of  the  algorithm  we  also  performed  a  simulation  run  in  which  users  were 
assigned  fixed  rates  as  determined  by  the  Centralized  Fair  Flow  control 
algorithm. 

Comparing  Fig.  5.4  and  5.5  we  can  observe  the  Important  advantage 
gained  by  incorporating  dynamic  flow  control.  The  advantage  is  that  in 
the  NO  CONTROL  case  the  flow  always  follows  number  of  actlver  users 
exactly,  whereas  in  the  control  case  the  algorithm  smooths  out  fluctuations 
in  the  number  active  users.  For  example,  examine  Fig.  5.4  for  the 
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time  Interval  [2,  2.8]  seconds. Note  that  the  number  of  actlver  users 
went  from  8  to  16  (.100*  Increase)  whereas  the  flow  only  went  from 
27  to  40  kbits/sec.  (48*  Increase).  In  contrast  examine  Fig.  5.5 
for  the  time  Interval  [2.2>2.6]  seconds.  Note  that  the  number  of  active 
users  went  from  10  to  13  (33*  Increase),  the  flow  went  from  32  to  45 
(40*  Increase),  the  Increase  Is  not  1  -  1  since  all  users  do  not  have 
the  same  rate. 


(seconds) 


EXPECTED  (N)  =  10 


(seconds) 
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Another  major  attribute  of  using  dynamic  rate  assignment  Is 
clearly  Illustrated  by  comparing  Fig.  5.6  and  Fig.  5.7,  where  the 
quantity  maximum  queue  size  refers  to  the  maximum  over  the  preceding 
100  ms.  Note  that  in  the  NO-CONTROL  case  a  slight  Increase  In  the 
number  of  active  users  could  result  in  large  queues  because  the  coding 
rate  of  all  users  who  utilize  link  2  Is  based  on  the  assumption  that 
link  2  always  will  have  ten  active  speakers  at  any  given  time, resulting 
In  an  average  rate  of  3.2  kilobits/sec/user.  Thus  when  N  rises  above 
13,  the  coding  rate  will  be  too  high  for  this  condition  and  the  desired 
link  flow  will  exceed  the  true  link  capacity  (40  kilobits/sec) ,  hence 
resulting  in  large  queues.  However  in  the  CONTROL  case  when  N  increases 
the  coding  rate  of  those  users  on  link  2  which  are  being  controlled  by 
link  2  will  decrease  to  compensate.  Thus  only  in  the  cases  where  the 
number  of  active  speakers  Increases  dramatically  (e.g.  50*)  over  a 
short  period  of  time  will  queues  be  able  to  build  up.  Furthermore, 
note  that  even  In  those  cases  the  maximum  queue  size  decreases  rapidly 
compared  to  duration  of  time  which  N  remains  large.  To  substantiate 
the  preceding  discussion  examine  Fig.  5.6  for  the  time  interval  [2. 5, 3. 3] 
seconds . 

The  performance  of  link  8  is  shown  in  Fig.  5.8  -  5.11.  The 
conclusions  drawn  from  examining  these  figures  are  consistent  with  those 
for  link  2. 


(seconds)  Figure  5.6 


(seconds) 


100  MS  EXPECTED  (N)  =  16 
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Figure  5.11 


C.  Jaffe's  Criteria 


We  extended  our  algorithm  to  Incorporate  Jaffe's  criteria  as 
discussed  In  section  4.5  and  ran  the  simulations  over  using  T-100  ms. 
The  results  for  link  2  are  shown  In  Figs.  5.12  -  5.13  and  those  for 
link  8  In  Figs.  5.14  and  5.15.  Comparing  these  results  with  those  of 
our  original  algorithm  we  find  that  by  Incorporating  Jaffe's  Idea  we 
apparently  eliminate  the  occurance  of  large  queues.  A  possible 
explanation  for  this  behavior  can  be  given  by  first  computing  some 
simple  averages. 

Control  (without  Jaffe's  criteria) 

Link  2: 

Desired  flow  *  32  (k  bits/sec) 

32 

Average  total  coding  rate  per  user  «  (y^)  ■  3.2  (kb/s) 

Average  control  value  *  8  (kb/s) 

Excess  capacity  *  (40-32)  *  8  (kb/s) 

Link  8 

Desired  flow  *  32  (kb/s) 

32 

Average  total  coding  rate  per  user  ■  (y^)  B  2  (kb/s) 

Average  control  value  *  2  (kb/s) 

Excess  capacity  =  40-32  =  8  (kb/s) 
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Control  (with  Jaffe's  criteria) 

Link  2; 

Desired  flow  »  (jy)  *  29  (kb/s)  (*) 

2Q 

Average  total  coding  rate  per  user  *  (jp)  «  2,9  (kb/s) 

Average  control  value  a  4.2  (kb/s) 

Excess  Capacity  *  40  -  29  *  11  (kb/s) 

(*)  where  the  factor  (jy)  comes  from  the  addition  of  the  fictitious  user 
Link  8; 

Desired  Flow  *  (|y)  (32)  *  30  (kb/s) 

Average  total  coding  rate  per  user  *  ^  *  1.9  (kb/s) 

Average  control  value  *  1.9  (kb/s) 

Excess  capacity  =  40-30  *  10  (kb/s) 

Link  2  has  users  which  are  controlled  by  link  2  as  well  as  users 
which  are  controlled  by  link  7  or  8,  whereas  link  8  has  control  over 
all  its  users.  Now  using  our  proceeding  results  we  can  compute  the 
average  number  of  additional  (i.e.  above  E(N))  users  which  can  be 
accommodated  on  link  2  without  causing  f2  >  40  (kb/s)  and  the  average 
number  of  additional  users  which  can  be  accommodated  on  link  8  without 
causing  fg  >  40  (kb/s). 


4 
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Llnk  2  (without  Jaffe) 

Best  case  -  all  new  users  are  controlled  by  link  7  or  8 

O 

Average  number  of  additional  users  “  f  *  4 

Worst  Case  -  all  new  users  are  controlled  by  link  2. 

O 

Average  number  of  additional  users  *5-  ■  1 

O 

Link  2  (with  Jaffe) 

Best  Case  -  all  new  users  are  controlled  by  link  7  or  8 

Average  number  of  additional  users  *  *  5 

Worst  Case-  all  new  users  are  controlled  by  link  2 

Average  number  of  additional  users  «  s  2 

Thus  by  using  Jaffe 's  criteria  we  are  able  to  improve  the  worst  case 
by  a  factor  of  2.  This  fact  can  significantly  improve  performance  (In 
terms  of  maximum  queue  size)  since  In  the  control  case  without  Jaffe's 
criteria  we  can  only  accommodate  One  additional  user  who  uses  link  2 

and  5  (there  are  only  2  total).  Thus  if  the  two  users  happen  to  become 

active  at  approximately  the  same  time  (i.e.  within  about  1/2  second) 
the  desired  link  flow  will  be  about  48  kb/s  resulting  in  the  rapid 
development  of  a  large  queue.  This  event  will  occur  on  the  average  about 
once  every  4  seconds  (e.g,  see  Fig.  5. 6), hence  it  is  not  negligible. 
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Link  8  (without  Oaffe) 

All  users  are  controlled  by  link  8 

Q 

Average  number  of  additional  users  =  j  *  4 
Thus  if  N (1 1  nk  8  without  J)  <  20  fg  <  40  (kb/s)  I 


Link  8  (with  Jaffe) 

All  users  are  controlled  by  link  8 

Average  number  of  additional  users  =  -  5.  II 

Thus  if  N(1  ink  8  with  Jaffe)  <  21  fg  <  40  (kb/s) 

The  preceding  results  do  not  offer  a  clear  explanation  for 
link  8.  Figure  5.15  illustrates  N  <  20  hence  (I)  is  satisfied  and  as 
expected  only  small  queues  develop.  In  contrast  if  we  examine  the 
result  for  the  control  case  (without  Jaffe)  i.e.  Fig.  5.10  we  find 
In  fact  that  N  actually  went  up  to  25  and  as  a  result  the  link  flow 
greatly  exceeded  the  true  capacity  (see  Fig.  5.8)  and  thus  large  queues 
developed.  Thus  we  conclude  that  good  performance  resulted  in  the  Jaffe 
case  because  we  were  lucky,  in  the  sense  that  N  never  rose  above  20. 

In  summary,  we  feel  Jaffe's  criteria  will  improve  performance  to  a 
certain  extent.  However,  because  we  performed  only  one  simulation  run 
using  this  criteria,  we  are  unable  to  draw  any  final  conclusions.  Thus 
more  and/or  longer  simulation  runs  should  be  performed  in  order  to  gain 
more  quantitative  results. 
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D.  Dynamic  Source  Rate  Behavior 


In  Figure  5.16  we  Illustrate  the  dynamic  behavior  of  sources  39 
when  our  original  algorithm  Is  used.  Since  source  39  Is  controlled 
by  link  2  we  would  expect  Its  rate  to  Increase  when  the  flow  on  link  2 
Is  below  the  effective  capacity  (l.e.  32  kb/s)  and  to  decrease  when 
f 2  >  C£»  This  can  be  verified  by  comparing  Figure  5.16  with  Figure  5.4. 

The  dynamic  rate  behavior  of  source  1  is  shown  in  Figure  5.17. In 
this  case  the  source  rate  is  fairly  constant  due  to  the  fact  that  the 
flow  on  link  8  (see  Fig.  5.8)  remains  reasonably  close  to  the  effective 
capacity  (l.e.  32  kb/s).  It  is  also  interesting  to  note  the  following; 
since  link  8  controls  all  its  users  we  expect  (32/16)  =  2  kb/s 
average  rate/user  and  by  examining  Fig.  5.17  we  see  that  this  is  indeed 
the  case. 

Similar  results  are  shown  in  Figs.  5.18  -  5.19  for  Jaffe's  criteria. 
The  only  difference  is  that  the  height  of  the  curve  has  been  multiplied 
by  a  factor  of  (-Jy)  for  source  39  and  by  (jy)  for  source  1,  to  compensate 
for  the  additional  excess  capacity  required  by  Jaffe's  criteria. 
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Figure  5.18 


-119- 


Statistics 

Tables  5.1  -  5.6  summarize  some  key  performance  results  for  the 
three  cases  previously  discussed.  Several  conclusions  can  be  drawn 
and  are  as  follows: 

(1)  No-control  yields  the  worst  performance  in  terms  of  delay. 

The  straight  control  case  yields  reasonable  delay  characteristics 
with  a  bonus  of  in  general  higher  coding  rates  when  compared 
to  the  No-Control  case.  Incorporating  Jaffe's  idea  results 
in  superior  delay  characteristics  at  the  expense  of  having 
the  lowest  coding  rates. 

(2)  As  expected  from  our  previous  discussion  Jaffe's  scheme 
yields  superior  performance  in  terms  of  MAX  QUEUE  size. 

However,  this  is  again  achieved  at  the  expense  of  having 
the  lowest  link  utilization  values. 

(3)  An  observation  which  can't  be  explained  is  the  fact  that 

in  almost  all  cases  the  link  utilization  is  below  the  desired 
value  of  80%. 

(4)  It  also  should  be  noted  that  since  links  1,2,3,  and  4  have 
equivalent  characteristics  that  they  should  yield  equivalent 
performance  especially  in  terms  of  link  utilization.  However, 
observing  Fig.  5.4  -  5.6  we  find  this  is  indeed  not  the 

case.  The  reason  for  this  being  that  the  simulation  runs 
were  definitely  not  long  enough  to  be  able  to  compute  averages 
although  they  yielded  informative  sample  path  behavior. 


SOURCE  -  STATISTICS 
T  *  100  MS 


Table  5.1 
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5.5  Comparison  to  the  Lincoln  Laboratory  Scheme 

Our  simulation  was  relatively  very  detailed  In  that  It  monitored 
each  packet  generated  by  each  source,  whereas  the  L.L.  simulation  did 
not.  Furthermore  In  [11]  there  are  no  results  presented  regarding  packet 
delays,  link  queue  sizes,  or  dynamic  link  behavior.  The  only  results 
which  we  presented  concern  the  dynamic  behavior  of  two  particular  sources. 
Another  important  difference  between  the  two  simulations  was  that  we  were 
only  concerned  with  (.1/10)  as  many  sources.  Thus  as  one  may  expect, 
results  regarding  dynamic  behavior  would  be  more  smoother  In  the  L.L. 
case  since  they  have  the  law  of  large  numbers  on  their  side. 

Thus  In  conclusion,  it  Is  not  possible  for  us  to  offer  a  fair 
comparison  between  our  scheme  and  the  Lincoln  Laboratory  scheme. 
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CHAPTER  VI 

CONCLUSION  AND  SUGGESTIONS 
FOR  FUTURE  WORK 

In  this  thesis  we  have  presented  two  flow  control  algorithms.  One 
algorithm  was  based  on  an  optimization  theoretic  approach.  The  second 
algorithm  had  the  property  that  the  rate  assignment  for  a  particular 
source  was  dependent  only  upon  the  network  condition  and  Independent 
of  the  number  of  links  which  the  source  utilized.  Thus  the  second 
algorithm  appears  more  desirable  for  packet-voice  networks  primarily 
because  of  the  proceeding  property. 

A  computer  simulation  program  was  developed  and  used  to  examine 
the  performance  of  the  second  algorithm  and  its  extension.  Results  in 
general  were  good  and  coincided  with  our  expectations.  However  our 
results  indicated  that  future  work  is  indeed  necessary  regarding  two 
Issues: 

(1)  Statistics  clearly  indicated  that  the  duration  of 
the  simulation  experiments  were  definitely  not  long 
enough  to  get  accurate  results. 

(2)  Our  algorithmic  development  was  based  upon  a  quasi¬ 
static  assumption,  but  after  examining  the  various 
sample  path  behavior  (Fig.  5.3  -  5.13)  and  statistics 
tables  (Tables  5.1  -  5.6)  it  Is  clear  that  more  work 
should  be  carried  out  to  carefully  study  the  dynamic 
behavior  of  the  network  traffic. 
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APPENDIX 


Computer  Simulation  Program 


time  basis  for  simulation  ■  10-4  seconds 
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